Has anyone tried in organization to use self hosted llm models for agentic programming?
Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…
Has anyone tried in organization to use self hosted llm models for agentic programming?
Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…
considering all the cloud ones are currently running at a loss, and hardware prices are way inflated: I doubt that.
If you think long term as a company that uses AI that’s the way to go anyway, your own AI server.
But alas, nobody cares about the long term, because the cunts at the top of the AI stack always make sure to make things so volatile that the little guy can never survive past the short term.
The solution? Oh just pay the big corporations to be dependent on them and not build your own thing. Surely that will help.
You have to realize, that by your own words, AI subscription prices will skyrocket eventually. So the cost analysis of your own AI server has to take that into account too, not just the current prices and current upfront cost.