silence7@slrpnk.net to Technology@lemmy.worldEnglish · 8 hours agoAI Companies Are Buying Tons of Old Books Because They're Free of AI Slopwww.404media.coexternal-linkmessage-square57fedilinkarrow-up1234
arrow-up1234external-linkAI Companies Are Buying Tons of Old Books Because They're Free of AI Slopwww.404media.cosilence7@slrpnk.net to Technology@lemmy.worldEnglish · 8 hours agomessage-square57fedilink
minus-squareAbouBenAdhem@lemmy.worldlinkfedilinkEnglisharrow-up5·6 hours agoThe article quotes a post from ISBNdb saying the issue is model collapse from training on synthetic data.
minus-squareRiskable@programming.devlinkfedilinkEnglisharrow-up1·2 hours agoThat’s like saying, “they had some failure modes from the synthetic data, so they should just obviously stop trying forever.” They’ll just fix the edge cases and move on. Like any programming task.
minus-squarecavitationfetishist2@quokk.aulinkfedilinkEnglisharrow-up1·3 hours agoYes, what’s the issue?
minus-squaredontbelievethis@sh.itjust.workslinkfedilinkEnglisharrow-up4·5 hours agoTotal collapse is a solution.
The article quotes a post from ISBNdb saying the issue is model collapse from training on synthetic data.
That’s like saying, “they had some failure modes from the synthetic data, so they should just obviously stop trying forever.”
They’ll just fix the edge cases and move on. Like any programming task.
Yes, what’s the issue?
Total collapse is a solution.
It’s also unavoidable.