• Smoogs@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    3 hours ago

    You’re comparing animals that run on instinct and hormones to software

    • exasperation@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      1
      ·
      3 hours ago

      What’s the difference, for the purposes of this discussion?

      Any system created out of many iterations, with feedback, of a reward/punishment system, will create complex systems that respond in complex ways. In that kind of complex system, changing a particular signaling pathway, or increasing or decreasing the weight of a factor/parameter, often has unpredictable or unintended effects.

      And if it is possible to someday create a conscious artificial general intelligence, I think it would have complexity and feedback loops created through a long process of rewards and punishments, rather than through intentional engineering. At that point hacking the details of that complexity runs risks of unintended consequences, and the complexity would bear the vestiges of the evolutionary reward system that created it.

      • Smoogs@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 hours ago

        Massive difference as Ai isn’t running with hormones underneath. I’d say that’s pretty important overlook to be attempting any comparison.

        • exasperation@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          1
          ·
          2 hours ago

          Hormones are just a signaling mechanism that affect behavior.

          Some future hypothetical conscious AGI would have feedback and signaling mechanisms, as well, including internal reward mechanisms.

          We can talk about robot biomechanics even if they’re operated on stored electrical charge on servos and motors, rather than ATP and myofibrils. The underlying chemistry doesn’t change the level of analysis we’re talking about here, because the lower levels create analogous higher level systems.