It’s actually pretty useful for those who need that use case.
They have one API for all the models, and when a few companies are offering the same models, they will send it to the one that is cheaper or faster, depending on the user’s settings. That kind of developer simplicity is pretty much why Stripe got popular too.
They also have a lot of data on which models are popular, which ones are being used by specific tools, etc.
Now that open weight and international models are getting popular over the american big tech ones, it seems like a lot of companies want something that can redirect their usage to whatever model fits within their preferred parameters.
Thanks for the clarification. Imagine buying the pipe command for 7.5 billion freedom bucks.
It’s actually pretty useful for those who need that use case.
They have one API for all the models, and when a few companies are offering the same models, they will send it to the one that is cheaper or faster, depending on the user’s settings. That kind of developer simplicity is pretty much why Stripe got popular too.
They also have a lot of data on which models are popular, which ones are being used by specific tools, etc.
Now that open weight and international models are getting popular over the american big tech ones, it seems like a lot of companies want something that can redirect their usage to whatever model fits within their preferred parameters.