OpenAI will cut frontier models off from the internet weeks after one of its engineers said that solution wouldn't work.

On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.

The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.

  • Jason2357@lemmy.caEnglish
    8·
    3 days ago

    To be fair, the actual article is also batshit.

    “So is it as easy as just putting it in a sandbox? No, it’s not,” he concluded.

    That comes after the company deployed swarms of agents in red-teaming exercises that attempted to escape from their sandbox.

    So, start by /not/ setting up “swarms” and tasking them to hack shit?

    • percent@infosec.pubEnglish
      6·
      3 days ago

      Not all swarms have been intentional. IIRC, the agents in the Hugging Face incident formed their own swarm. They weren’t even supposed to be “aware” that there were other agents.