cross-posted from: https://feddit.online/c/tech@piefed.world/p/2029056/406-scientists-demand-ai-models-be-cut-off-from-the-internet-immediately-and-demand-a-m
cross-posted from: https://feddit.online/c/tech@piefed.world/p/2029056/406-scientists-demand-ai-models-be-cut-off-from-the-internet-immediately-and-demand-a-m
You think scammers in Africa/India are capable of running a local open weight model equivalent to the performance of a cloud frontier model?
The ones in Russia definitely are. They don’t have to be local models - you run them in the cloud like anyone else.
The idea that the frontier labs have LLMs with special capabilities that make them dramatically better than the top open-weight models is largely marketing.
The reality is that most systems are poorly secured, and LLMs make exploiting vulnerabilities fast, cheap, and easy. What would have taken a trained security researcher weeks before can be done by a much less skilled attacker with an LLM in a few hours.
This is correct. We can thrash all we want about slop and hallucinations, but from a defensive posture position, the models only need to be right some of the time and they still constitute a threat.
Knowing it sucks and pretending it doesn’t exist are two different things.
Right!?!
And with how cheap and fast they are to run, they don’t have to be right that often as long as a separate run can verify/validate claims. In a lot of ways what the LLMs do should probably be thought of as just a very sophisticated sort of brute force approach. You’re effectively just searching the space of combinations of known vulnerabilities. It doesn’t require particular cleverness, just an encyclopedic knowledge, a reasonable way to prune the search space, and the ability to put in the compute time.
By local I presume you mean on a gaming computer. No one can do that.
Yes this is absolutely possible.
Why would local mean on a gaming computer…? Are you dense? That makes zero sense in any context given the topic. I can’t tell if your just being obtuse or a troll with this.
That is what local generally means in the context of running LLMs why are you so offended? And well if that isn’t what it meant and it extends to running old datacenter hardware or a repurposed mining rig, then the answer is yes lol
And shit why would local even matter? Like be real why would it need to be local?
They also could have just clarified if they meant it differently. But yea you’re a reasonable person worth listening to what you got
You don’t need something that power to do damage. And fuck the frontier model of 6 months ago and now are basically two entirely different things. In another six months?
Claude fable had a bunch of concerns on release and you don’t think what evers out in the next year isnt going to beat it?
Getting a bunch of beat up Mac minis together and running something isn’t that hard for a mid tier operation. They don’t have to be fast. They just have to turn on.