• ag10n@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    2
    ·
    23 hours ago

    That’s what an LLM is, a database of words using vectors.

    You’re still limited by the context window in your example, giving it another source of information doesn’t do anything than give more context.

    • thinkercharmercoderfarmer@slrpnk.net
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      3
      ·
      20 hours ago

      Right, i mean if you made the context window enormous, such that you can include the entire set of embeddings and a set of memories (or maybe, an index of memories that can be “recalled” with keywords) you’ve got a self-observing loop that can learn and remember facts about itself. I’m not saying that’s AGI, but I find it somewhat unsettling that we don’t have an agreed-upon definition. If a for-profit corporation made an AI that could be considered a person with rights, I imagine they’d be reluctant to be convincing about it.