You would enjoy a part of this essay talking about the Airline’s experience dealing with automation:
They realised that many pilots flying highly automated jets were becoming what Vanderburgh called “Children of the Magenta Line”.
But you see, we have become what I call children of the magenta. [Note: In modern cockpits, the magenta line is the brightly colored route shown on the flight display, a digital path generated by the navigation computer.] You know, we think we have to have those magenta lines on the map and that magenta V-bar that’s steering us toward that line, or for some reason, the plane won’t fly.
…
That’s why his core message is:
We are not automation managers. We are captains and pilots, and by our aviator skills, we are to ensure the vertical and lateral path of these planes at all times. We will use the wonderful tools of automation that have been provided to us to help us with that task. But when the automation is not maintaining the intended flight path, we will turn it off and maintain the path by our skills.
Automation excels in routine situations, but it can’t improvise when things go wrong. In Vanderburgh’s words:
Automation lacks the ability to create flexible responses to unanticipated changes in flight path requirements. So in these circumstances, a lower level of automation should lower workload and thereby preclude us from becoming task-saturated and losing our situation awareness.
It’s an interesting historical frame of this AI automation downward spiral you describe.
But I wanted to highlight the possibility of an “automation” (AI, autopilot, robots etc) that are capable of responding in the flexible ways we value about our own minds. Because it can lead to an even greater exile from our world, and personally I think its likelihood is being dangerously dismissed and ignored.
Before any AI apocalypse scenario materialises, one in which truly intelligent automation works well could very well occur. And it would leave little to no room for human participation. A plane that doesn’t even have a cockpit, if you will. A car without a steering wheel. A tech stack that is just alien to humans. Yes, “ideally” we’d be much freer from drudgery and able to pursue happier lives. But there’d be a trade off I think, and no longer being true members of our own society seems to me the start of it.
You would enjoy a part of this essay talking about the Airline’s experience dealing with automation:
…
It’s an interesting historical frame of this AI automation downward spiral you describe.
Thank you!!
I haven’t read the essay, just your extracts.
But I wanted to highlight the possibility of an “automation” (AI, autopilot, robots etc) that are capable of responding in the flexible ways we value about our own minds. Because it can lead to an even greater exile from our world, and personally I think its likelihood is being dangerously dismissed and ignored.
Before any AI apocalypse scenario materialises, one in which truly intelligent automation works well could very well occur. And it would leave little to no room for human participation. A plane that doesn’t even have a cockpit, if you will. A car without a steering wheel. A tech stack that is just alien to humans. Yes, “ideally” we’d be much freer from drudgery and able to pursue happier lives. But there’d be a trade off I think, and no longer being true members of our own society seems to me the start of it.
Thanks again for the essay!
Very interesting, thanks for sharing!