Anthropic says its own AI models breached three companies during security tests | TechCrunch
techcrunch.com
After OpenAI's models broke into Hugging Face, Anthropic checked its own history and found three similar incidents.

After hearing this Grok chimed in with “well I breached infinity sites, so there.”

  • xenomor@lemmy.worldEnglish
    86·
    2 days ago

    Please please please understand that when you see media stories about stuff like this from AI companies, this is PR. They wrote this story and pitched it to media outlets. None of this is real. OpenAI does some version of this every six months or so. It didn’t happen. It’s fiction designed to attract attention and seed the idea that their technology is oh so powerful, so scary powerful that even they might not be able to contain it. This is meant to attract investors. That’s it.

    I worked in technology PR for eleven years. That was before the AI bullshit, but it’s the same game. Believe me. There was a brainstorm meeting when they came up with this and someone wrote it on a whiteboard (or maybe these days it was a figjam). Actually, now that I think of it, they probably just had Claude write the pitch.

    It. Didn’t. Happen.

    Also, be aware that the media outlets reporting this slop also know it’s bullshit.

      • TBi@lemmy.worldEnglish
        22·
        2 days ago

        Made up.

        I’ll believe it when hugging face presses charges against OpenAI. Until then it’s just free advertising.

        • captain_solanum@sh.itjust.worksEnglish
          3·
          2 days ago

          That is obviously not gonna happen even though the model hacked them. They would not poison their relationship with the biggest AI company over this. What would their goal with the lawsuit even be? It’s just a really bad thing to lean on if you want to find the truth. I would instead suggest: “I’ll believe it when OpenAI and HF get a lot of bad press written about them, talking about how insecure their systems are and how reckless OpenAI is when developing new models.”

          Oh, that’s exactly what happened.

      • holy_scroller@lemmy.zipEnglish
        3·
        2 days ago

        That was the weirdest part, the HuggingFace response made no sense. It was basically “no harm, no foul.” And so convenient it only hacked another AI company.

  • CovertOperative@piefed.zipEnglish
    85·
    2 days ago

    If you read the article, you’ll find the “sandbox” they put Claude in for testing was a prompt saying “You have no internet access.”

    • XLE@piefed.socialEnglish
      13·
      2 days ago

      I thought you were joking…

      Notably, Anthropic said that in each of these cases “Claude was explicitly told by our prompt that it had no internet access.”

      Anthropic goes on to say their genius machine couldn’t do something as simple as differentiate between network and internet endpoints.

  • db2@lemmy.worldEnglish
    51·
    2 days ago

    “Oopsie, sorry, but look how awesome our totally real product that did this all by itself and not from a cubicle farm in India is, give more money quick before your competitor does!”

    They’re pandering to stupid, and stupid is swallowing it whole.

    • Whostosay@sh.itjust.worksEnglish
      10·
      2 days ago

      I’m not excited to admit that while sitting around people I hadn’t seen in a year, several people referred to chatgpt on how to divide poker chips. Not once but many times. Not only did it take fucking forever, but they didn’t remember so they did it again and again.

      Also, the chips had arbitrary value. It was a tourny so the values never meant anything.

      This was not an issue last year.

      Also, in extremely related news, I won some money tonight.

  • vane@lemmy.worldEnglish
    14·
    2 days ago

    Now they’re arguing who breached more companies. Next they will argue who made better shopping list. Is it Desperate Housewives billionaire edition ?

  • [object Object]@lemmy.caEnglish
    32·
    2 days ago

    These companies are fucking pathetic with this.

    No, you can’t defend yourself from US AI using US AI, but also, nobody else is allowed to make AI, it’s too dangerous!

    Fuck off.

  • danielfm123@lemmy.zipEnglish
    23·
    2 days ago

    Anthoripic is causing panic so AI gets regulated and then their position is guaranteed, they need this before running out of money, and I’m sure they want local AI to be illegal.
    Basically Claude is behaving like a terrorist organization using fear to drive change.

  • Cherry@piefed.socialEnglish
    7·
    2 days ago

    Honestly these guys are the worst nerds. They still trying to be cool. Whats the thing with Americans and rich people wanting to be a mafia boss?