There’s some fear mongering going around (pushed by AI companies to build hype) about AIs “going rogue” or “breaking containment” or other anthropomorphic language suggesting that AIs are capable of acting on their own.
These stories are all verifiably false though, the computer does not do things without being asked to by someone.
To be clear, I’m fully against AI. I just don’t like when I see people giving it credit for shit it cannot and did not do, or ascribe sentience to it, or some dumb shit like that.
I mean, that’s a matter of definition, isn’t it? If I ask a coding agent or whatever to implement something, and it circumvents the sandbox to do it, causing damage in the process, I’d be comfortable calling that “going rogue”. I have had that happen, without the damage part, luckily. I guess you can counter that I asked it to do the something, but then I don’t think we agree on the definitions.
I also think that if you’re against AI, you’d be doing yourself a disservice by not keeping up with the actual capabilities of the thing you oppose. The latest models are surprisingly good at e.g. coding, so basing your arguments on them being useless is not the most efficient strategy.
To also be clear, I don’t see any way AI disappears now, so I believe we’ll have to make the best of it (and in complete isolation, it is an utterly fascinating area of - to me - complete science fiction). Ideally development slowed down now so we could regroup and adapt, but I’m not too hopeful. The maximalist techbro endgame is so obviously a matter of national security for both China and the US, that there’s no way either of them will dare to wind it down, in case SV is actually right.
Not only did you ask it to do something, you left a path for it to escape the sandbox and encouraged it to do so.
Are you suggesting that because they instructed the computer to do something, without specifying how it should be done, and the computer followed its instructions , that’s somehow “going rogue?”, it was literally following instructions, that’s what computers do.
Yes, I understand that they are “good” (enough) at coding to sometimes put together something functional, that is literally what LLMs are designed to do. Coding languages are languages, ones without the subjectivity of human communications. They are easier to recognize patterns in, there are more rules. That’s literally the one task LLMs are good at, and they’re still not as good as an actual quality human programer.
Local AI models might never go away for coding, but they certainly won’t be shoehorned into everything without a good use case the way they are now.
AI is not a matter of national security, that is a lie being perpetrated by the captured media and politicians for the purpose of propping up their non-viable business models for long enough to squeeze all of the Juice they can out of investors (who are nearly dry at this point). That’s just additional techbro fear mongering. To distract you while they’re digging in our pockets.
I don’t think “computer follows instruction” is the right angle to look at this from. The instructions that the literal computer followed were a ton of matrix multiplication operations. The consequences of that arithmetic is easier to analyze as the emergent behaviour of the “gestalt” that produces the words that calls the tools etc. (This is also the reason that dismissing the entire field as “stochastic parrots” and “spicy autocomplete” misses the mark - if you want to predict the next word all the way through a counterexample to the Jacobian Conjecture, it’s hard to see how that can be done without a - for lack of a better word - mental model of the problem)
If you do any coding at all, I encourage you to look at what the latest models output. The average quality of work from a frontier model is amazing. Yes, there are bugs, but with adversarial auto-review it’s absolutely on par with a journeyman human programmer. The problem is of course that if you don’t hire junior programmers and let them do that work, you’ll never get new experts, and that’s a clear worry.
My point with the national security angle was that if you extrapolate just a little bit from current capabilities, you get to a point where an “AI gap” is a problem, regardless of the techbro claims. Keeping a close eye on that is firmly within the responsibility of a national government. Personally, I don’t see any good outcomes from an AI race like that, unless we actually hit a hard ceiling on further expansion. Fingers crossed.
What do you mean by “on its own”?
I mean “without human intervention or input”
There’s some fear mongering going around (pushed by AI companies to build hype) about AIs “going rogue” or “breaking containment” or other anthropomorphic language suggesting that AIs are capable of acting on their own.
These stories are all verifiably false though, the computer does not do things without being asked to by someone.
To be clear, I’m fully against AI. I just don’t like when I see people giving it credit for shit it cannot and did not do, or ascribe sentience to it, or some dumb shit like that.
I mean, that’s a matter of definition, isn’t it? If I ask a coding agent or whatever to implement something, and it circumvents the sandbox to do it, causing damage in the process, I’d be comfortable calling that “going rogue”. I have had that happen, without the damage part, luckily. I guess you can counter that I asked it to do the something, but then I don’t think we agree on the definitions.
I also think that if you’re against AI, you’d be doing yourself a disservice by not keeping up with the actual capabilities of the thing you oppose. The latest models are surprisingly good at e.g. coding, so basing your arguments on them being useless is not the most efficient strategy.
To also be clear, I don’t see any way AI disappears now, so I believe we’ll have to make the best of it (and in complete isolation, it is an utterly fascinating area of - to me - complete science fiction). Ideally development slowed down now so we could regroup and adapt, but I’m not too hopeful. The maximalist techbro endgame is so obviously a matter of national security for both China and the US, that there’s no way either of them will dare to wind it down, in case SV is actually right.
Not only did you ask it to do something, you left a path for it to escape the sandbox and encouraged it to do so.
Are you suggesting that because they instructed the computer to do something, without specifying how it should be done, and the computer followed its instructions , that’s somehow “going rogue?”, it was literally following instructions, that’s what computers do.
Yes, I understand that they are “good” (enough) at coding to sometimes put together something functional, that is literally what LLMs are designed to do. Coding languages are languages, ones without the subjectivity of human communications. They are easier to recognize patterns in, there are more rules. That’s literally the one task LLMs are good at, and they’re still not as good as an actual quality human programer.
Local AI models might never go away for coding, but they certainly won’t be shoehorned into everything without a good use case the way they are now.
AI is not a matter of national security, that is a lie being perpetrated by the captured media and politicians for the purpose of propping up their non-viable business models for long enough to squeeze all of the Juice they can out of investors (who are nearly dry at this point). That’s just additional techbro fear mongering. To distract you while they’re digging in our pockets.
I don’t think “computer follows instruction” is the right angle to look at this from. The instructions that the literal computer followed were a ton of matrix multiplication operations. The consequences of that arithmetic is easier to analyze as the emergent behaviour of the “gestalt” that produces the words that calls the tools etc. (This is also the reason that dismissing the entire field as “stochastic parrots” and “spicy autocomplete” misses the mark - if you want to predict the next word all the way through a counterexample to the Jacobian Conjecture, it’s hard to see how that can be done without a - for lack of a better word - mental model of the problem)
If you do any coding at all, I encourage you to look at what the latest models output. The average quality of work from a frontier model is amazing. Yes, there are bugs, but with adversarial auto-review it’s absolutely on par with a journeyman human programmer. The problem is of course that if you don’t hire junior programmers and let them do that work, you’ll never get new experts, and that’s a clear worry.
My point with the national security angle was that if you extrapolate just a little bit from current capabilities, you get to a point where an “AI gap” is a problem, regardless of the techbro claims. Keeping a close eye on that is firmly within the responsibility of a national government. Personally, I don’t see any good outcomes from an AI race like that, unless we actually hit a hard ceiling on further expansion. Fingers crossed.