sanitation@lemmy.today to Programmer Humor@programming.dev · 6 hours agoNew compression techniquelemmy.todayimagemessage-square46fedilinkarrow-up1479file-text
arrow-up1479imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 6 hours agomessage-square46fedilinkfile-text
minus-squareMikina@programming.devlinkfedilinkarrow-up10·edit-25 hours agoIs it a compression when you need presumably gigabites of a model to reconstruct the data? It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
minus-squareryannathans@aussie.zonelinkfedilinkarrow-up3·edit-24 hours agoA roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text
Is it a compression when you need presumably gigabites of a model to reconstruct the data?
It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
A roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text