But you’ll need a powerful system with 64GB of RAM to use it.

Microslop thinks that “Clutter free” means “bundled with an always on LLM” 😸

  • jtrek@startrek.website
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 hours ago

    I’m pretty sure local models still induce pyschosis and hallucinate. Maybe the cat’s out of the bag, but they still suck.

    • TheFogan@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      They absolutely do suck, but I can see some practical uses for them. IE I can see LLM’s as useful in localized specialized uses. for me I’d really like basically LLM as a like calendar, scheduling kind of thing, also say translating home assistant commands through a voice assistant to make it figure out actual intent etc…, nothing super mission critical, but also mostly things I wouldn’t want any 3rd party service that could change the rules for me, share them to others etc…