• atzanteol@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 hour ago

    This is false. There is a pile of research demonstrating that copies of training data can be extracted from trained models, going back at least 5 years. If the model can reproduce a copy of the original, then it must be stored in the neural network in some form.

    They also generate novel output. Lots of it. Is that novel output in the model too because it can be reproduced from the model?

    “Can be extracted from” is not the same as “exists in the model”. I can write a random letter generator that will eventually spit out real words. But those words don’t “exist” in my code.