As society's repositories of knowledge, I feel like AI should fall under libraries. Especially considering how AI utilizes others knowledge/text they don't legally have rights to. The carveout we made slightly similar (in that they have special rules for their use) is for libraries.
An 8-bay Synology costs about $1000. It'll hold an eighth of a petabyte pretty comfortably (with sufficient redundancy). It's bizarre and disturbing to me how few of you seem to be interested in having your own libraries, even though technology has finally delivered that ability to you. You'll come on here once every 3 months and whine about how we have to do more for public libraries, even though they seem to largely be little more than daytime homeless shelters and free internet for perverts, and you don't even want libraries for yourselves.
The "library" is dying for the same reason the newspaper (and the book!) is dying. Literacy was only interesting for most people as a means to pass the time until they could get their hands on AI slop Tiktok feeds.
I don't need a carveout. Some large fraction of my internet bandwidth is downloading books and whatnot off of Libgen and Anna's.
Libraries serve a lot purpose than you are giving credit for.
Libraries are a general facility for the public, they offer the standard books and other rental type arrangements although they are so much more than that!
- Access to computers
- Access to internet
- Access to printing
- Access to 3D Printing
- Access to Meeting rooms
- Access to Mental Health Services
- Access to Archive Rooms (newspapers, seed archives, etc).
They serve as a repository for everything physical. Most libraries have archive rooms with various artifacts from the region, including newspapers, publications, recordings, etc. Most of this stuff isn't available online.
Visit a library near a University or School and it becomes packed full of students researching and studying, even if most aren't accessing the books, the rooms, desk and facilities themselves are important.
Not everyone is willing to pirate books, willing to setup Synology devices, etc. A library grants an official place to access things in a legal way, easily (and for free!) among many other things.
Practically no one is willing to do it. They'd have to be interested in books first. And no one is. Not only is "books" not the first thing in your list, it's not even the last thing. Books might have once been seen as luxuries, and the idea of a lending library allowed those in poverty to get a taste of wealth, so to speak... but they get dumped into landfills by the truckload today and can be had for pennies (or fractions of pennies, actually). So you don't want them anymore.
It's bizarre that it hurts you so much to tell a truth about you which couldn't be more plainly obvious. You don't like books. The book publishing industry is literally dying, that's how little you like books.
>A library grants an official place to access things in a legal way, e
But none of you want to access them. You just like the idea that, if somehow you suddenly did want a book, that you'd be able to go get one for free, effortlessly. Because even if you did want a book, you sure as hell wouldn't want one badly enough to expend an iota of effort to obtain one.
Books might have once been seen as luxuries, and the idea of a lending library allowed those in poverty to get a taste of wealth, so to speak... but they get dumped into landfills by the truckload today and can be had for pennies (or fractions of pennies, actually).
Well those ones might be, but the ones I want sure aren't. I have to moderate my book-purchasing to avoid over-spending. The library is pretty helpful (reservation fees are more than I'd like, but a lot less than buying); some years I draw a couple of hundred books. But a lot of them I end up buying. Got one in my hand that was just delivered minutes ago (the new partial biography of Jobs about his years outside Apple).
I guess where this train of thought is going is to point out that people like me do exist. I do spent a lot on books. I borrow a lot from the library. Your assertions come across very strongly suggesting that people like me are a rounding error. But I assure you, when I'm in the bookstore I'm definitely not the only person there. Between us we appear to be propping up entire publishing industries. Almost 80% of the sales are physical rather than digital (1); if we weren't here there would be nothing for you to pirate!
> I have to moderate my book-purchasing to avoid over-spending.
I sympathize, but do it smarter. I downloaded 500 or so last week, and it was a slow week. Mostly I mine Hacker News and /pol/ (it's actually only half as bad as reddit once you ignore Mein Kampf) for recommendations... but ran a little short on those. Coming up with new titles to procure is tough.
>I guess where this train of thought is going is to point out that people like me do exist.
I know! There are half-dozens of you out there! And I know I struck a nerve, because HN hates "my anecdote counters your intended generalization" except when you have to examine hard truths about yourselves.
>very strongly suggesting that people like me are a rounding error.
A rounding error on a rounding error.
>Almost 80% of the sales are physical rather than digital
Physical sales are dead. If you listen to anyone who writes and has written for the last 20 years or more, you'll hear all sorts of heartache stories about what sales are like now compared to back before it all fell apart. It's dead. And it's never coming back. Your grandchildren, if you have any, won't even know how to open a book.
The price for that storage system will be far more dominated by drive prices than by the cost of the NAS box itself. Drive prices have approximately doubled in my area vs. 2 years ago.
This is also generally a selfish attitude where you personally benefit while structures that used to benefit society at large are eroded.
> price for that storage system will be far more dominated by drive prices...doubled in my area vs. 2 years ago.
Absolutely. To get 1/8 PB = 125 TB home library "easily":
We'll use 8 disks in the 125TB library. Between RAID 5 (1 disk lost OK to recover) vs RAID 6 (2 disks lost OK to recover), choose RAID 6 (our disks could fail at same time if of similar production or unlucky). RAID6 means 25% of space used for parity overhead, and 2-5% used for metadata/filesystem.
So looking for about 163TB. 163TB / 8 rounds to 21 TB. This pushes us above 16TB disks. Between 20TB and 22TB, choose 22Tb to feel safe.
Napkin math:
Synology 8-bay DS: $1150 (Amazon price)
8x 22TB Seagate 22TB external 3.5" = 8 x $390 = $3120 (also the #1 least expensive disk per TB for 3.5" external at https://diskprices.co currently)
So we're at $1150+$3120 = $4270 for one library.
But something cvan happen to that. Fall, fire, water, theft, party. We could lose everything.
So following 3-2-1 we'll have 3 copies, on 2 media, with one offsite.
Copy 2 can be same as first (RAID is for disk redundancy not backup -- we still have one copy only).
By now, 2x Synology 8-bays, plus 16x 22TB disks, puts us at $8540 for what we can keep at home.
But disks only really last about 5 years. They're getting kinda better, but in reality those disks can fail and should be replaced about every 5 years, some people get 10.
So every 5 years, we can want to shell ou;t about $8540. But wait, disks about doubled in the past year. Maybe it'll be $16,000 next time? Hard to say.
We still need a 3rd, off-site copy for 3-2-1. Recent reports indicated Backblaze silently lost data, some people exodused I believe. To where? IDK, but let's pick Amazon Glacier deep storage. At 125TB (just useful data), at $0.00099/GB/mo, that puts it at, over the same 5 years: $0.00099/GB/mo * 125000 GB * 12mo * 5yr = $7,425/5yr
(For the remote copy: can your ISP actually handle uploading 125TB? How long does that take to do once, even half? Is ISP transfer capped? Will 3rd party storage provider change prices or lose data? That's why we have 3 copies, maybe change providers when needed.
In any case, add it on 3-2-1 for 125TB would cost, at the easiest/cheapest: $4270 * 2 + $7,425 = 4270+7425 = $15,965, good for about 5 years.
So, every 5 years, spending $15,965.
At these volumes, are do even have ECC RAM? Are we scanning for and correcting errors with correct data when they occur? We don't want a hobby, we want an appliance, for this library, often especially if we work 99% of the time in tech and have life to live, quite likely.
Let's try another formula: on a shoestring and a hope, one could do it "cheap on RAID 5 (only 12.5% lost to parity and metadata/filesystem) and under-storage without 3-2-1" by going Synology 8-bay ($1150, Amazon) + 8 * 16TB (8 * $410 per https://diskprices.co = $3280) = $1150 + $3280 = $4430
---
In grand summary, roughly every 5 years:
Done "right": $15,965
Done "cheap": $4,430 and only 112TB usable.
You know what, 112TB starts to feel like not that much, when we look at the size of some of the libraries out there.
Averaged over 5 years (though it's not) these are:
- Right: $15,965 / 5yr = about $3,200/yr (plus tax) for 125TB usable library
- Cheap: $4,430 / 5yr = $886/yr (plus tax) for 112TB usable library
If a techie makes $150K, that's about 0.6%-2% of income, if we forget taxes (sales or income) entirely.
Maybe doable. But it's like owning another car in more ways than one (cost, maintenance/ongoing-care). Some individuals can swing it without even thinking. Most can't.
IMO, if the AI industry or any players would like us to become more computer centric, and make use of all the data that tech now lets us have, its constituents should do something (anything) to drive the cost of disks DOWN, not UP.
Well, yes, but it is in fact owning a copy of approximately 10% of all human knowledge ever produced. Someone doing this is clearly doing it for reasons other than personal consumption.
The same argument could be made about any public service. Certainly, if libraries were funded to the tune of $1000 for every household, they would be very different places.
And you'll have your nice library and can read whenever you want from the comfort of your own home, and while most people will pirate shit libraries can be great for making things accessible without a $60/month mobile charge, especially when people can't afford shelter.
> Literacy was only interesting for most people as a means to pass the time until they could get their hands on AI slop Tiktok feeds.
Its funny to me how the people who so readily declare certainty about the future constantly demonstrate their utter ignorance of the human spirit. Whats the whole basis for this country again?
