Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

    • plasma8726@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      Thanks for this link. Because of this article, I had claude stand up a llama.cpp container next to my already running ollama container. It ran side by side tests with the same model and parameters, and the results blew ollama out of the water. I’m in the process of moving hermes and openwebgui over to the llama.cpp instance to see how it goes day to day.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        2 hours ago

        If you’re using docker anyway, and “fast” pure GPU models, you might try a vllm container while you’re at it.

        It should be much faster than even llama.cpp, albeit at the cost of context length, and it supports some exotic 4-bit quantization like SPQA.

        Same with TabbyAPI. It’s quantization is SOTA, though it does not support CPU offloading, and it’s speed is somewhere between vllm and llama.cpp.

      • tristynalxander@mander.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        It’s not that hard to use llama.cpp directly anyway. Why would I use a wrapper when I can just run a python script?

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        5 hours ago

        Or exllama! Vllm, sglang, Lorax. Koboldcpp, Aphrodite, text-generation-webui, LM Studio, powerinfer, ktransformers, mlc-LLM, really whatever floats your boat. Just not ollama, specifically.

    • pinball_wizard@lemmy.zip
      link
      fedilink
      English
      arrow-up
      6
      ·
      14 hours ago

      I agree that the concerns listed there are smells, and I wasn’t aware of some of the options listed there.

      Thank you for sharing this!

    • comrademiao@piefed.social
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      16 hours ago

      looks like extreme nitpicking without any real issues beyond some VC funding a FOSS issues.

      //whyre you spamming the comment to everyone? its quite alarmist actually

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        15
        ·
        edit-2
        14 hours ago

        I completely disagree.

        Frankly, I find the description “VC funding a FOSS” offensive. They aren’t funding the engine. I’ve been messing with LLM inference engines since 2022, and Ollama is the worst I’ve seen in the community.

        They misname models for SEO. They leech off llama.cpp while deliberately hiding attribution yet redirecting GH support requests there. They sometimes make their own GGUFs+forked releases which are broken and incompatibile with upstream llama.cpp, just so they can get a release out a day ahead for hype, even though it doesn’t really work and they’ll never upstream one line. They set a default context size thats basically unusable, they screw up chat templates and deep internal code with no obvious indicators, they release suboptimal quants without iMatrix, they gate you into their internal quantization repo and model card format, they hide model downloads on your hard drive, they mess with standard APIs for no good reason other than to mess up other backends. I could go on and on.

        And if that’s all fine, they’re enshittifying the app with closed code, and pointers to cloud models.

        They GIVE LLM inference a bad name, by making it a terrible quality engine that happens to show up in search as the “default.” Hence the comments below of people being unimpressed with local inference. And they sap attention from actual llama.cpp devs, without contributing a single dime. Everyone in the localllama communtity hates their guts, and that’s not even getting into the interpersonal drama they’ve stirred.

        They are a leech that’s a net drag to the whole community, that we can’t get rid of because they’re attention grifters. And they’ve gotten worse and worse over time.


        It’s more morale to use any cloud API over Ollama, in my eyes. They’re a grift.


        EDIT: And, to be clear, I’m not against VC funded downstream stuff.

        LM Studio is good! Even though it’s closed source.

        Tons of downstream projects are great.