I like LLMs but I want to run them locally and for that I need RAM that I can’t really afford. Especially Chinese models are good candidates to run locally, I wonder if that’s part of the US strategy, I mean making local inference so expensive that people have to use their models if they don’t want to send all their data to China
I like LLMs but I want to run them locally and for that I need RAM that I can’t really afford. Especially Chinese models are good candidates to run locally, I wonder if that’s part of the US strategy, I mean making local inference so expensive that people have to use their models if they don’t want to send all their data to China