• WesternInfidels@feddit.online
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 hours ago

    They’re using domain-specific LLMs to compress narrow-domain data. Their text compression LLM was trained on, and then tested on, legal text and medical text.

    There’s no reason one couldn’t apply the domain-specific-compressor idea to a conventional lossless text compressor, essentially moving much of the dictionary from the compressed file to the program itself. I don’t know if anyone’s tried that. I’d like to know how that compares.