• ag10n@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    13 hours ago

    That’s what an LLM is, a database of words using vectors.

    You’re still limited by the context window in your example, giving it another source of information doesn’t do anything than give more context.

    • thinkercharmercoderfarmer@slrpnk.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 hours ago

      Right, i mean if you made the context window enormous, such that you can include the entire set of embeddings and a set of memories (or maybe, an index of memories that can be “recalled” with keywords) you’ve got a self-observing loop that can learn and remember facts about itself. I’m not saying that’s AGI, but I find it somewhat unsettling that we don’t have an agreed-upon definition. If a for-profit corporation made an AI that could be considered a person with rights, I imagine they’d be reluctant to be convincing about it.