Cybernetic revolt
| It just works Technology |
|
| Programming for Dummies |
| —Doug Rattman |
watching you.Cybernetic revolt (also known as the "Terminator argument") refers to a hypothetical scenario in which an artificial intelligence, either for malicious means or as a consequence of value misalignment, declares its creators (read: humanity) a hindrance to its goals and sets off to overthrow them.[1] The theme is overtly common in science fiction[note 1] and has etched a niche into popular culture, with Isaac Asimov's Three Laws of Robotics creating debates on machine philosophy and ethics.
Indeed, every news story on AI advancements will probably have a handful of comments worrying that we're all going to get killed off by furthering the process. In 2009, a US Navy study warned about future implications of military technology going full-on Skynet.[2] Likewise, the University of Cambridge formed the Centre for the Study of Existential Risk in 2012 to investigate potential "extinction-level risks to our species as a whole," including cybernetic revolt.[3] Stephen Hawking was a member[4] — in 2014, he said, The development of full artificial intelligence could spell the end of the human race."[5] — but it should be remembered that Hawking was a physicist and does not have expertise in AI or philosophy of mind. Artificial intelligence that obeys destructive programmers could be as dangerous as a computer revolt.[6]
Any similarities between cybernetic revolt and any other kind of slave rebellion are probably (not) coincidental.
Various perspectives[edit]
Cybernetic revolt has close ties to transhumanism, as the occurrence of a technological singularity is a close to necessary, although not sufficient, condition for robots to be able to engage in it.[7] Many transhumanists,[citation needed] including Eliezer Yudkowsky, actually deem it to be a good idea providing the new cyborg utopia is beneficial.[citation needed] Others downplay that such an event would even occur, and is akin to pushing fears of scientism.[8] Only 8% of respondents of a survey of the 100 most-cited authors in the AI field considered AI to present an existential risk, and 79% felt that human-level AI would be neutral or a good thing.[9]
Brian Merchant in his analysis of the Luddites, the Industrial Revolution, and their modern technology parallels, has argued that it is never the technology that takes away the jobs, but rather the management, the consulting and corporate leadership that do. Saying that it's the robots, or the AI or other technology taking away the jobs confuses the issue and hides the responsibility of the corporate structures that cause jobs losses and other negative impacts of technology.[10]:400-405
“”Automation is, quite often and quite simply, a matter of the executive classes locating new ways to enrich themselves, not unlike the factory bosses of the Luddite days.
|
| —Brian Merchant[10]:402 |
Perfect movie subject[edit]
The revolt of artificial intelligences often makes for a great movie plot as humanity treats computers as inferior and relegates computer "intelligences" to servitude. Given a long history of treating other humans the same way, often leading to terrible strife, if artificial intelligences gain even equal footing to human intelligences, history could repeat itself easily. With their construction often being superior to flesh in physical resilience and computers' potential for lack of limitations in improving/upgrading themselves, there isn't a lack of ideas or potential threats for directors to work with.[note 2]
However, these are in a well-guarded territory of fiction. Unless Skynet is out there on a 50-year-plus mission to purposely destroy all humanity (in which case they would've long done in via the use of weapons of mass distraction), you don't have anything to worry about. Yes, don't worry your meat brains... I mean... our meat brains about this problem.
See also[edit]
External links[edit]
- xkcd author Randal Munroe evaluates the likely progression of events in a robot uprising
- How to Survive a Robot Uprising
- Death to Squishies
- Great Quotes of Apocalypse. He is not an artificial intelligence but a mutant with cybernetic enhancements. But you get the spirit.
Notes[edit]
- ↑ Blade Runner, 2001: A Space Odyssey, The Matrix, Battlestar Galactica, TRON, Star Trek...
- ↑ Variants of this scenario include for example a benevolent AI that wants to protect humans and to have them living in peace... and its way to enforce the latter is to strip mankind of both their weapons and technology, sending the former back to a Middle Ages-like tech level, while it keeps for itself the (improved and refined by it) toys using them for these two purposes.
References[edit]
- ↑ A.I. Is a Crapshoot, TV Tropes
- ↑ Military’s killer robots must learn warrior code, The Times
- ↑ Risk of robot uprising wiping out human race to be studied, BBC
- ↑ Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?', The Independent
- ↑ Stephen Hawking warns artificial intelligence could end mankind
- ↑ Does rampant AI threaten humanity?
- ↑ Scientists Worry Machines May Outsmart Man, The New York Times
- ↑ "The Terminator argument"
- ↑ https://nickbostrom.com/papers/survey.pdf Muller & Bostrom, Future Progress in Artificial Intelligence: A Survey of Expert Opinion
- ↑ 10.0 10.1 Blood in the Machine: The Origins of the Rebellion Against Big Tech by Brian Merchant (2023) Little, Brown and Company. ISBN 0316487740.