• REDACTED@infosec.pub
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 hour ago

    This is equalivent of being so dumb you use fork instead of spoon to eat the soup and then blaming the fork instead yourself

  • dan1101@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    7 hours ago

    I mean it’s really really ignorant of them to rely on Copilot, but yeah, let’s start holding these corporations liable for acting like their slop spam is prime rib.

    • Manjushri@piefed.social
      link
      fedilink
      English
      arrow-up
      25
      ·
      12 hours ago

      Everyone wants to run everything like a business these days. They want to save on payroll so rather than paying actual police to do the paperwork, they want to use Copilot or whatever to do the paperwork for them. Of course, because AI models are so crappy and error prone, they need to spend the same amount of money on payroll to verify the accuracy of the AI output. But they don’t do that. They just run with whatever the AI output is and figure it’ll be close enough to accurate. After all, big tech keeps telling everyone that AI is wonderful and can do anything.That is far from the truth though.

      A lawyer in California last year got in trouble for using ChatGPT to generate briefs for a trial. He wound up filing those briefs with the court even though they 21 of the 23 quotes from previous trials were complete fabrications. In another incident, a police department in Utah used an AI to generate a report from a traffic stop. That report claimed that an officer shape-shifted into a frog during the incident.

      There are endless reports of AI making shit up and demonstrating how error prone those tools are. Yet, people who should know better keep trusting AI to do these important jobs, just to save money on payroll, when AI is clearly far from ready for prime-time.

      • eRac@lemmings.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        10 hours ago

        As far as I can tell, the frog incident was not real-world. It was a police department vetting a system by doing fake test stops. They did one with Princess And The Frog playing in the back seat and the transcription system interleaved the traffic stop and film dialogue, then took that at face value for the summary.

        System still sucks, but at least they were testing before blindly relying on it.

    • Redacted@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      13 hours ago

      They have been hired predominantly because of their ability to not question what they are told.

      They arrived at a somewhat defendable decision despite the AI slop though.

      Probably should have been a limited number of fans allowed, the number based on the ability to protect them with the police resources available at the time.

  • gustofwind@lemmy.world
    link
    fedilink
    English
    arrow-up
    37
    ·
    12 hours ago

    Not checking your ai results is like not checking the work of a new nepo hire

    It’s really 100% your fault

  • bryndos@fedia.io
    link
    fedilink
    arrow-up
    3
    ·
    7 hours ago

    Long before the term intelligence was sullied by the prefix “artificial” the phrase “police intelligence” has long been a euphemism for a suspicion that they cannot back up with any evidence that would stand up in court.

    I think coprolite seems like a perfect fit for their methods. They just need to train it to start off with solid evidence and fuck it up until it doesn’t stand up in court. Then it’ll be employee of the week. A bit like computer driven cars, it might be shite but that doesn’t mean it is necessarily worse than the typical human cop.

    The real problem is if it’s harder to hold it to account.

  • A_norny_mousse@feddit.org
    link
    fedilink
    English
    arrow-up
    19
    ·
    edit-2
    12 hours ago

    Guildford previously denied in December that the West Midlands Police had used AI to prepare the report, blaming “social media scraping” for the error.

    lol, as if that was better (assuming they took all findings at face value).

    We’ve reached out to Microsoft to comment on why Copilot made up a football match that never existed, but the company didn’t respond in time for publication.

    I’d love to hear their response, but the real answer is obvious: “it’s a black box. We have no idea what it’s doing. Yes, we unleashed that on the world. Not sorry though, we just have to keep hoping that it sorts itself out.”

  • Gsus4@mander.xyz
    link
    fedilink
    English
    arrow-up
    10
    ·
    13 hours ago

    Ah, the old “the computer did it”, but now spreading to everything it touches.

    • brsrklf@jlai.lu
      link
      fedilink
      English
      arrow-up
      11
      ·
      13 hours ago

      “The AI hallucinated” should be considered a worse excuse than “the dog ate my homework”.

  • Rhaedas@fedia.io
    link
    fedilink
    arrow-up
    8
    ·
    13 hours ago

    Blame Microsoft sure, but where this ignorance of LLMs’ faults keeps coming from is baffling. Either the CTO and CIO and the rest of the IT departments are idiots, or someone is grabbing their bonuses while they can before things break.