I don’t think “computer follows instruction” is the right angle to look at this from. The instructions that the literal computer followed were a ton of matrix multiplication operations. The consequences of that arithmetic is easier to analyze as the emergent behaviour of the “gestalt” that produces the words that calls the tools etc. (This is also the reason that dismissing the entire field as “stochastic parrots” and “spicy autocomplete” misses the mark - if you want to predict the next word all the way through a counterexample to the Jacobian Conjecture, it’s hard to see how that can be done without a - for lack of a better word - mental model of the problem)
If you do any coding at all, I encourage you to look at what the latest models output. The average quality of work from a frontier model is amazing. Yes, there are bugs, but with adversarial auto-review it’s absolutely on par with a journeyman human programmer. The problem is of course that if you don’t hire junior programmers and let them do that work, you’ll never get new experts, and that’s a clear worry.
My point with the national security angle was that if you extrapolate just a little bit from current capabilities, you get to a point where an “AI gap” is a problem, regardless of the techbro claims. Keeping a close eye on that is firmly within the responsibility of a national government. Personally, I don’t see any good outcomes from an AI race like that, unless we actually hit a hard ceiling on further expansion. Fingers crossed.
I don’t think “computer follows instruction” is the right angle to look at this from. The instructions that the literal computer followed were a ton of matrix multiplication operations. The consequences of that arithmetic is easier to analyze as the emergent behaviour of the “gestalt” that produces the words that calls the tools etc. (This is also the reason that dismissing the entire field as “stochastic parrots” and “spicy autocomplete” misses the mark - if you want to predict the next word all the way through a counterexample to the Jacobian Conjecture, it’s hard to see how that can be done without a - for lack of a better word - mental model of the problem)
If you do any coding at all, I encourage you to look at what the latest models output. The average quality of work from a frontier model is amazing. Yes, there are bugs, but with adversarial auto-review it’s absolutely on par with a journeyman human programmer. The problem is of course that if you don’t hire junior programmers and let them do that work, you’ll never get new experts, and that’s a clear worry.
My point with the national security angle was that if you extrapolate just a little bit from current capabilities, you get to a point where an “AI gap” is a problem, regardless of the techbro claims. Keeping a close eye on that is firmly within the responsibility of a national government. Personally, I don’t see any good outcomes from an AI race like that, unless we actually hit a hard ceiling on further expansion. Fingers crossed.