• AlteredEgo@lemmy.ml
    link
    fedilink
    arrow-up
    1
    ·
    1 hour ago

    There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.

    But I’m really just half mocking the very careful language used by the comment I replied to.