sanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agoNew compression techniquelemmy.todayimagemessage-square163fedilinkarrow-up11.24Kfile-text
arrow-up11.24KimageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agomessage-square163fedilinkfile-text
minus-squareMikina@programming.devlinkfedilinkarrow-up17·edit-21 month agoIs it a compression when you need presumably gigabites of a model to reconstruct the data? It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
minus-squareryannathans@aussie.zonelinkfedilinkarrow-up8·edit-21 month agoA roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text
Is it a compression when you need presumably gigabites of a model to reconstruct the data?
It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
A roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text