silence7@slrpnk.net to Technology@lemmy.worldEnglish · 2 days agoAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comexternal-linkmessage-square46fedilinkarrow-up1219
arrow-up1219external-linkAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comsilence7@slrpnk.net to Technology@lemmy.worldEnglish · 2 days agomessage-square46fedilink
minus-squareTechnus@lemmy.ziplinkfedilinkEnglisharrow-up27·2 days agoIt’s glorified autocorrect (/predictive text). People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind. In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.
It’s glorified autocorrect (/predictive text).
People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind.
In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.