There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.
i would err towards it ingesting proprietary code before this, it’s not wrong but AI spits out copyrighted and should-be private stuff all the time.
There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.