They’re using domain-specific LLMs to compress narrow-domain data. Their text compression LLM was trained on, and then tested on, legal text and medical text.
There’s no reason one couldn’t apply the domain-specific-compressor idea to a conventional lossless text compressor, essentially moving much of the dictionary from the compressed file to the program itself. I don’t know if anyone’s tried that. I’d like to know how that compares.
They’re using domain-specific LLMs to compress narrow-domain data. Their text compression LLM was trained on, and then tested on, legal text and medical text.
There’s no reason one couldn’t apply the domain-specific-compressor idea to a conventional lossless text compressor, essentially moving much of the dictionary from the compressed file to the program itself. I don’t know if anyone’s tried that. I’d like to know how that compares.
There’s a number of compression projects working on this, this is the first that comes to mind
https://bellard.org/nncp/
https://bellard.org/ts_zip/