Yeah especially because they now have some convoluted method involving different counts of processing, cache etc. But the developer has no easy way of seeing those statistics and thus has no feel for them. And developers already have little control over how much tokens a task takes. Which was fine with the flat rate, just use the service. But now that those things actually matter, the stats should be way easier to see?
So in typical Microsoft fashion not only did they raise prices they somehow made it even more shit. Like the AI already sucked, but does the service itself need to suck as well?
Not being able to control costs and very vague productivity improvement claims makes the ROI impossible to calculate. So even if the AI wasn’t shit, it would still be hard to figure out if it’s even helping at all.
Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing
Yeah especially because they now have some convoluted method involving different counts of processing, cache etc. But the developer has no easy way of seeing those statistics and thus has no feel for them. And developers already have little control over how much tokens a task takes. Which was fine with the flat rate, just use the service. But now that those things actually matter, the stats should be way easier to see?
So in typical Microsoft fashion not only did they raise prices they somehow made it even more shit. Like the AI already sucked, but does the service itself need to suck as well?
Not being able to control costs and very vague productivity improvement claims makes the ROI impossible to calculate. So even if the AI wasn’t shit, it would still be hard to figure out if it’s even helping at all.
Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing