Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…

  • HelloRoot@lemy.lol
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    GLM is pretty good in mg experience, the company I currently freelance at runs it locally for compliance reasons. But it needs very beefy hardware.