Or… honestly, just pay $40 for basically unlimited usage for a year from an API, then roll your own frontend.
Can you clarify, what you mean by this? Rent a VPS? Or is there a legitimately good place that’ll offer “unlimited” llm api access for $40 / year (and would you have any sort of privacy with this)?
My mistake, it’s $60. But that’s still dirt cheap.
You can read their terms of service; coding APIs are generally less invasive than something like the ChatGPT app, but don’t bet on any privacy either.
For my personal setup, I actually run most queries locally, via MiMo 2.5, but send “bulk” privacy-insensetive prompts to the same model on the API, since its so much faster. I kinda use them in parallel.
I also forgot to emphasize this, but Xiaomi’s plan, in my opinion, is undiscovered fruit.
GLM had a similar coding plan, but once it got in the news and popular, it got WAY more expensive and limited. I’m grandfathered into 6 more months of a GLM plan you literally cannot buy now.
And I think Xiaomi is in the same situation GLM was 6+ months ago. It’s a fantastic model series, but unlike Kimi/GLM no one knows about it yet, which is how it’s still $60 for a year.
Can you clarify, what you mean by this? Rent a VPS? Or is there a legitimately good place that’ll offer “unlimited” llm api access for $40 / year (and would you have any sort of privacy with this)?
I was thinking of Xiaomi’s Lite coding plan:
https://platform.xiaomimimo.com/token-plan
My mistake, it’s $60. But that’s still dirt cheap.
You can read their terms of service; coding APIs are generally less invasive than something like the ChatGPT app, but don’t bet on any privacy either.
For my personal setup, I actually run most queries locally, via MiMo 2.5, but send “bulk” privacy-insensetive prompts to the same model on the API, since its so much faster. I kinda use them in parallel.
Thanks for sharing the link. I’ll take a peek at them and their ToS.
I also forgot to emphasize this, but Xiaomi’s plan, in my opinion, is undiscovered fruit.
GLM had a similar coding plan, but once it got in the news and popular, it got WAY more expensive and limited. I’m grandfathered into 6 more months of a GLM plan you literally cannot buy now.
And I think Xiaomi is in the same situation GLM was 6+ months ago. It’s a fantastic model series, but unlike Kimi/GLM no one knows about it yet, which is how it’s still $60 for a year.