Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…

  • mesa@piefed.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    Ive played around with a couple, mostly from hugging face. Some of the minimal modelsvare halfway decent at SQL and some specific ones are good with templates and html. You cam string them up for agentic work without issue. I found the performance worse than generation tools for the same software tasks. It was neat to try though.