How dare you critique me, a rank amateur with mediocre knowledge about a few subjects? Especially with this reasoned argument?!
But yeah, my main takeaway is “the code must be complex in order to meaningfully analyze anything, and the more complex the thing it can analyze, the even-more-complex it must itself be.”
Yeah, with sufficient complexity it’s more along the lines of “I created a procedure that makes this complex thing” rather than “I built this complex thing up piece by piece.”
So if the act of creation is considerably less complex than analyzing and understanding a part of that creation, it’s far more likely that the complexity gap ends up preventing any self-aware AGI from being able to effectively reinvent oneself, even if it does have full write access to the components.
How dare you critique me, a rank amateur with mediocre knowledge about a few subjects? Especially with this reasoned argument?!
But yeah, my main takeaway is “the code must be complex in order to meaningfully analyze anything, and the more complex the thing it can analyze, the even-more-complex it must itself be.”
Good stuff!
Yeah, with sufficient complexity it’s more along the lines of “I created a procedure that makes this complex thing” rather than “I built this complex thing up piece by piece.”
So if the act of creation is considerably less complex than analyzing and understanding a part of that creation, it’s far more likely that the complexity gap ends up preventing any self-aware AGI from being able to effectively reinvent oneself, even if it does have full write access to the components.