• Zarobi@aussie.zone
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    In an ideal universe, A.I. could have been a good and helpful tool. But in the world we live in, that’s unfortunately impossible.

    The closest we have to good, is a local LLM running on your (comparatively) tiny consumer graphics card, which is barely powerful enough to reword an email.

    • ms.lane@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 day ago

      You can spill over to system RAM on unsloth now.

      It’s slower, but that’s better than not being able to run something.