Microsoft was deceptive here and never made it clear exactly what sort of deal you were getting with the flat rate. There was no indication of the actual magnitude.
Yeah especially because they now have some convoluted method involving different counts of processing, cache etc. But the developer has no easy way of seeing those statistics and thus has no feel for them. And developers already have little control over how much tokens a task takes. Which was fine with the flat rate, just use the service. But now that those things actually matter, the stats should be way easier to see?
So in typical Microsoft fashion not only did they raise prices they somehow made it even more shit. Like the AI already sucked, but does the service itself need to suck as well?
Not being able to control costs and very vague productivity improvement claims makes the ROI impossible to calculate. So even if the AI wasn’t shit, it would still be hard to figure out if it’s even helping at all.
Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing
Yeah, what’s the surprise here? Turns out it’s expensive.
Microsoft was deceptive here and never made it clear exactly what sort of deal you were getting with the flat rate. There was no indication of the actual magnitude.
It was easy to know how much the slop machine costs to run if you bothered to put even a tiny effort into finding out.
Yeah especially because they now have some convoluted method involving different counts of processing, cache etc. But the developer has no easy way of seeing those statistics and thus has no feel for them. And developers already have little control over how much tokens a task takes. Which was fine with the flat rate, just use the service. But now that those things actually matter, the stats should be way easier to see?
So in typical Microsoft fashion not only did they raise prices they somehow made it even more shit. Like the AI already sucked, but does the service itself need to suck as well?
Not being able to control costs and very vague productivity improvement claims makes the ROI impossible to calculate. So even if the AI wasn’t shit, it would still be hard to figure out if it’s even helping at all.
Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing
It was very much a red flag when they shut down signups.