Have they looked into middle-out lossless data compression developed by Richard Hendricks?

They made technology necessary to function in society and then they began gatekeeping it.

This is like stealing all the water.

Get out of our cyberspace. These people should be jailed.

Why do I feel a new dark age incoming

Can’t have hardware for us to archive. That’s only for the ai overlords to archive the internet for their own personal Ai models.

Technology gentrification go brrr

Just tell all the other computer related businesses they’re aren’t going to have any new customers.

“We gather over 100 terabytes of new materials each day, […]”

First I was like “What the hell? How can that much be worth saving?” But then I remembered it doesn’t only save web pages, but video, audio, and software as well. Sheesh, tough job.

There’s still a little time to get in at reasonable prices before they truly blow up and go insane. I’ve definitely started seeing increases such as a WD 8TB that went from $204.99 to $239.99 overnight after a short period of being out of stock. Depending on brand and size, some are still available at retail prices, but they’re quickly running out.

You will remember nothing and be happy.

Use tape libraries for the moment, with hard drives acting as a cache for them? Doesn’t need to mean moving the whole backing storage to tape, just predicting what won’t likely be used soon and letting the storage format indicate “go look on tape for this item”. Obviously, that can result in much higher cold storage retrieval latency, but as long as you are (a) doing predictive fetching with a reasonably good algorithm and (b) have a lot of hard drives, which I’m sure that The Internet Archive does, I’d think that tape should be workable.

https://en.wikipedia.org/wiki/Tape_library

In computer storage, a tape library is a physical area that holds magnetic data tapes. In an earlier era, tape libraries were maintained by people known as tape librarians and computer operators and the proper operation of the library was crucial to the running of batch processing jobs. Although tape libraries of this era were not automated, the use of tape management system software could assist in running them.

Subsequently, tape libraries became physically automated, and as such are sometimes called a tape silo, tape robot, or tape jukebox. These are a storage devices that contain one or more tape drives, a number of slots to hold tape cartridges, a barcode reader to identify tape cartridges, and an automated method for loading tapes (a robot). Such solutions are mostly used for backups and for digital archiving. Additionally, the area where tapes that are not currently in a silo are stored is also called a tape library. One of the earliest examples was the IBM 3850 Mass Storage System (MSS), announced in 1974.

In either era, tape libraries can contain millions of tapes.

Physically automated tape library devices can store immense amounts of data, ranging from 20 terabytes[13] up to 2.1 exabytes of data[14] as of 2016.

For large data-storage, they are a cost-effective solution, with cost per gigabyte as low as 2 cents USD.

I’d also guess — though I don’t know for sure — that it’s probably a lot easier to scale up manufacturing of tapes than it is hard drives.

EDIT: Does kind of make me wonder what the open-source options for tiered storage like that is. I’ve never really gone hunting, but it seems like there’d be a lot of commonality from place to place, and that for a lot of places that do it, it’s not really their core competency (that is, they just want to do something that deals with storing and processing lots of data, not that they really care principally about data storage).