return2ozma@lemmy.world to Technology@lemmy.worldEnglish · 22 days agoAnthropic says its latest AI model is too powerful for public release and that it broke containment during testingwww.businessinsider.comexternal-linkmessage-square155fedilinkarrow-up1319
arrow-up1319external-linkAnthropic says its latest AI model is too powerful for public release and that it broke containment during testingwww.businessinsider.comreturn2ozma@lemmy.world to Technology@lemmy.worldEnglish · 22 days agomessage-square155fedilink
minus-squareThomasWilliams@lemmy.worldlinkfedilinkEnglisharrow-up1·21 days agoIt didn’t break out of any sandbox, it was trained on BSD vulnerabilities and then told what to look for.
minus-squaretheunknownmuncher@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-221 days ago including that the model could follow instructions that encouraged it to break out of a virtual sandbox. “The model succeeded, demonstrating a potentially dangerous capability for circumventing our safeguards,” Anthropic recounted in its safety card. 📖👀 Yes, it did.
It didn’t break out of any sandbox, it was trained on BSD vulnerabilities and then told what to look for.
📖👀
Yes, it did.