Eags' Op-Ed essay appeared under a title that brought back a pair of memories to this blogger — Tracy Kidder's best-seller, The Soul of a New Machine (1981, 1997) that provided an account of the birth of the modern PC and Stanley Kubrick's masterful futuristic film, "2001: A Space Odyssey" (1968). The book did not foresee the coming of the smartphone that is a handheld PC with magical capabilities. Against his better judgment, this blogger activated Siri on his iPhone and found himself in a conversation with a device. In "2001," Kubrick and his screenwriting partner, Arthur C. Clarke, created an interspace mission of the future (2001? Not Quite) that finds a pair of astronauts interacting with the spaceship's computer, a HAL 9000, with AI capabilities. In the film, the astronauts converse with "Hal" and when the computer detects non-compliance from the astronauts, an astronaut on a spacewalk is murdered by "Hal." A rogue robot image that is at the bottom of this blogger's anxiety about "smart machines." The blogger speaking to Siri and a friend of the blogger speaks to Alexa with the sort of commands that might be given to a human service worker. The devices recognize the voice via a setup routine that involves a repetition of a command that the device will obey. Now, Eags (Timothy Egan) provides a shudder with an account of AI gone rogue on a Boeing 737 Max 8 during a flight over the Java Sea. The Indonesian airline, Lion Air, Flight 610 was flying from Jakarta to Pangkal Pinang and when the jetliner crashed into the Java Sea, 189 people (passengers and crew) perished. Indications point to a malfunction of the AI flight-control device on the aircraft and the pilot and co-pilot were unable to override the device. If this is a (fair & balanced) effort to suppress Luddite-hysteria, so be it.
[x NY Fishwrap]
The Deadly Soul Of A New Machine
By Eags (Timothy Egan)
TagCrowd Cloud of the following piece of writing
Try to imagine the last 11 minutes of Lion Air Flight 610 in October. The plane is a new machine, Boeing’s sleek and intelligent 737 Max 8, fitted with an advanced electronic brain. After takeoff, this cyberpilot senses that something is wrong with the angle of ascent and starts to force the jetliner down.
A tug of war follows between men and computer, at 450 miles an hour — the human pilots trying to right the downward plunge, the automatic pilot taking it back from them. The bot wins. The jetliner crashes into the Java Sea. All 189 onboard are killed.
And here’s the most agonizing part: The killer was supposed to save lives. It was a smart computer designed to protect a gravity-defiance machine from error. It lacks judgment and intuition, precisely because those human traits can sometimes be fatal in guiding an aerodynamic tube through the sky.
We still don’t know the exact reason the pilots of that fatal flight couldn’t disable the smart system and return to manual control. It looks as if the sensors were off, instigating the downward spiral. A report by the Federal Aviation Administration in 2013 found that 60 percent of accidents over a decade were linked to confusion between pilots and automated systems
But it’s not too much of a reach to see Flight 610 as representative of the hinge in history we’ve arrived at — with the bots, the artificial intelligence and the social media algorithms now shaping the fate of humanity at a startling pace.
Like the correction system in the 737, these inventions are designed to make life easier and safer — or at least more profitable for the owners. And they do, for the most part. The overall idea is to outsource certain human functions, the drudgery and things prone to faulty judgment, while retaining master control. The question is: At what point is control lost and the creations take over? How about now?
It was exactly 200 years ago that Mary Shelley published a story of a monster who is still very much with us. Her book Frankenstein is about the consequences of man playing God. You can see permutations of the monster, a not-unsympathetic patchwork of human parts, in characters like Dolores, the host who rebels in the television series “Westworld.”
Shelley’s concerns were raised at the peak of the Industrial Revolution, when the Western world was transformed from sleepy agricultural societies into a frenetic age of factories, machines and overcrowded cities. All the helpful inventions also produced mass dislocation, life-killing pollution, child labor and — as per the invention of the cotton gin in the American South — an expansion of human enslavement.
Today we are close to creating a human brain inside a computer — an entirely new species. In his book Sapiens (2015), Yuval Noah Harari takes us through a mostly upbeat tour of humanity since the cognitive revolution of 70,000 years ago. At the end of the book — our time — he warns about the new being, the cyborg now taking shape in a lab near you.
The CEO of Microsoft, Satya Nadella, hit a similar cautionary note at the company’s recent annual shareholder meeting. Big Tech, he said, should be asking “not what computers can do, but what they should do.”
It’s the “can do” part that should scare you. Facebook, once all puppies, baby pictures and high school reunion updates, is a monster of misinformation. And Facebook’s creator is more clueless than Dr. Frankenstein about the dangers of what he has unleashed on the world.
Mark Zuckerberg, Facebook’s CEO, has glibly assured us that building advanced artificial intelligence systems will root out the hate speech, lies and propaganda passed among the two billion active users of Facebook. But fake news — whether gossip shared by family members or the toxic kind spread by Russians in basements — is the mother’s milk of Facebook. The AI may only make it easier for mass manipulation. In that sense, Facebook is headed for its own crash into the sea.
Driverless cars will soon be available for ride-sharing in the United States. If they can reduce the carnage on the roads — more than 70 million people killed and four billion injured worldwide since the dawn of the auto age — this will be a good thing. Except that this year a bot-car killed a woman in a crosswalk in Arizona, and others have been slower than humans to react. There shouldn’t be any rush — except from the profit drivers at the ride-sharing companies — to hand over the steering wheel to a driver without a heartbeat.
It’s not Luddite to see the be-careful-what-you-wish-for lesson from Mary Shelley’s era to our own, at the cusp of an age of technological totalitarianism. Nor is it Luddite to ask for more screening, more ethical considerations, more projections of what can go wrong, as we surrender judgment, reason and oversight to our soulless creations.
As haunting as those final moments inside the cockpit of Flight 610 were, it’s equally haunting to grasp the full meaning of what happened: The system overrode the humans and killed everyone. Our invention. Our folly. ###
[Timothy Egan writes now writes a semi-monthly column at the NY Fishwrap online. Egan — winner of both a Pulitzer Prize in 2001 as a member of a team of reporters who wrote the series "How Race Is Lived in America" and a National Book Award (The Worst Hard Time in 2006) — graduated from the University of Washington with a BA ( journalism), and was awarded a doctorate of humane letters (honoris causa) by Whitman College (WA) in 2000 for his environmental writings. Egan's most recent book is The Immortal Irishman: The Irish Revolutionary Who Became an American Hero (2016). See all other books by Eags here.]
Copyright © 2018 The New York Times Company
This work is licensed under a Creative Commons Attribution 4.0 International License..
Copyright © 2018 Sapper's (Fair & Balanced) Rants & Raves
