Has anyone tried in organization to use self hosted llm models for agentic programming?
Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…
Has anyone tried in organization to use self hosted llm models for agentic programming?
Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…
Even commercial, service-based LLMs demand a great effort of quality control, with their hallucinations and all. With local ones being mid in comparison from my experience, my suggestion would be that if your company does try implementing any, they should make sure to at least pay a nice extra to the QA folks.