• Electricd@lemmybefree.net
    link
    fedilink
    English
    arrow-up
    14
    ·
    edit-2
    24 hours ago

    I want to run LLMs locally, or things like TTS or STT locally so it’s nice but there’s no real support rn

    Most people won’t care nor use it

    LLMs are best used when it’s a user choice, not a platform obligation

    • ulterno@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 minutes ago

      I guess an NPU is better of being a PCIe peripheral then?
      And it can then have their specialised RAM too.