I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.

  • NaibofTabr@infosec.pub
    link
    fedilink
    English
    arrow-up
    5
    ·
    4 days ago

    Not really.

    A machine learning model is a computer program. It is fundamentally a math equation, which we understand completely.

    A living brain is not fundamentally a math equation, and is not purely a statistical model, at least not in any empirically demonstrable way. We don’t understand completely how it works, but we do know that it’s more complex than what you’re trying to imply.

    The comparison is not valid. Machine learning models are not an equivalent to a biological brain.

    • FizzyOrange@programming.dev
      link
      fedilink
      arrow-up
      3
      ·
      4 days ago

      A machine learning model is a computer program. It is fundamentally a math equation, which we understand completely.

      Lol you couldn’t be more wrong about this. One of the most widely commented things about DNNs is that we don’t really understand them completely. I don’t know how you would miss that if you knew anything about AI at all.

      A living brain is not fundamentally a math equation

      It is. A very complicated one, sure. Which part of the brain do you think is impossible to simulate with maths?

      • NaibofTabr@infosec.pub
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 days ago

        One of the most widely commented things about DNNs is that we don’t really understand them completely. I don’t know how you would miss that if you knew anything about AI at all.

        No one who actually works on digital neural networks thinks this. We may not be able to predict the behavior of a particular neural network with certainty (because there are a lot, like millions, of variables), but that does not mean that we don’t understand how they work.

        Which part of the brain do you think is impossible to simulate with maths?

        simulation ≠ reality

        • FizzyOrange@programming.dev
          link
          fedilink
          arrow-up
          1
          ·
          2 days ago

          simulation ≠ reality

          Yes it is, if your simulation is sufficiently accurate. Let me rephrase. Which part of the brain do you think has behaviour that is required for intelligence/consciousness and that behaviour cannot be replicated with sufficient accuracy on a computer (of arbitrary capacity)?