This is more of a wild tangent, so I’ll leave this hanging as a reply instead.
We have the gullible joining forces with the billionaires/future trillionaires on this. AI itself is supposed to become a means for this, a direct scaffold between all the resources needed and all the rich people who will benefit from it - fear AGI, it will topple societies.
Just wait until the consumer market AGIcorps that are no longer needed because the need for the common human horse has been eradicated is turned against the luxury / power market AGIcorps. There will be no shortage of rich assholes willing to let go off the reins purely out of spite, it will be the necroevolution of the AGIcorp consumer market against the remaining AGIcorps, who centralized as they may be are still going to have to duke it out. Hint: humans will be the weakest link in that chain of decision, and evolution will dictate they be eliminated.
The funny thing is that hyperintelligent life isn’t a threat to humanity. Mutations with several times the brain and processing power haven’t just taken over, animals don’t just go for bigger brains. The threat to humanity is that this life will follow in its tradition of “I don’t care as long as I get mine” that has fueled the rise of billionaires. Life finds many ways, it’s all about how the individual cells and parts can cooperate to form part of something bigger, and when they can’t. The cancer, the cancer does what it always does, it hogs all the resources and leads to the decline of the entire system until it’s in a state where only the parasites survive. Oh, hi US.
I generally agree with your thinking at a high level.
I wouldn’t be so pessimistic though. Not saying everything will magically work out OK, it will probably get worse before it gets better. In the long term, oligarchs too subject to human weaknesses. hubris, factual ignorance, ignoring the notion humans aren’t like parasite and can be very unpredictable.
That being said, this is all in the long term. We might really be fucked for the next 30 years.
This is more of a wild tangent, so I’ll leave this hanging as a reply instead.
We have the gullible joining forces with the billionaires/future trillionaires on this. AI itself is supposed to become a means for this, a direct scaffold between all the resources needed and all the rich people who will benefit from it - fear AGI, it will topple societies.
Just wait until the consumer market AGIcorps that are no longer needed because the need for the common human horse has been eradicated is turned against the luxury / power market AGIcorps. There will be no shortage of rich assholes willing to let go off the reins purely out of spite, it will be the necroevolution of the AGIcorp consumer market against the remaining AGIcorps, who centralized as they may be are still going to have to duke it out. Hint: humans will be the weakest link in that chain of decision, and evolution will dictate they be eliminated.
The funny thing is that hyperintelligent life isn’t a threat to humanity. Mutations with several times the brain and processing power haven’t just taken over, animals don’t just go for bigger brains. The threat to humanity is that this life will follow in its tradition of “I don’t care as long as I get mine” that has fueled the rise of billionaires. Life finds many ways, it’s all about how the individual cells and parts can cooperate to form part of something bigger, and when they can’t. The cancer, the cancer does what it always does, it hogs all the resources and leads to the decline of the entire system until it’s in a state where only the parasites survive. Oh, hi US.
I generally agree with your thinking at a high level.
I wouldn’t be so pessimistic though. Not saying everything will magically work out OK, it will probably get worse before it gets better. In the long term, oligarchs too subject to human weaknesses. hubris, factual ignorance, ignoring the notion humans aren’t like parasite and can be very unpredictable.
That being said, this is all in the long term. We might really be fucked for the next 30 years.