{"id":389530,"date":"2025-09-01T15:26:14","date_gmt":"2025-09-01T15:26:14","guid":{"rendered":"https:\/\/www.europesays.com\/uk\/389530\/"},"modified":"2025-09-01T15:26:14","modified_gmt":"2025-09-01T15:26:14","slug":"our-ai-fears-run-long-and-deep","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/uk\/389530\/","title":{"rendered":"Our AI Fears Run Long and Deep"},"content":{"rendered":"

\u201cThis is the voice of World Control,\u201d a metallic, nonhuman baritone blared from a spherical speaker atop a bank of computers. \u201cI bring you peace. It may be the peace of plenty and content, or the peace of unburied death.\u201d The men and women in the room\u2014the greatest minds in the American scientific establishment\u2014froze in horror. The computer, a defense system that had become self-aware after gaining control of the world\u2019s nuclear weapons, continued: \u201cThe object in constructing me was to prevent war. This object is attained.\u201d And then it detonated two ICBMs inside their silos as a warning to humans not to interfere with its benevolent rule.<\/p>\n

The time was the early 1970s. The setting was a movie titled Colossus: The Forbin Project<\/a>. I saw it as a boy, and I remember being both fascinated and frightened, but Colossus wasn\u2019t the first or last time that a story about a renegade AI would put a scare into me and other fans of science fiction. AI is one of the great hopes, and great fears, of the 21st century, but for more than 50 years, popular culture has been wrestling with the idea of computer sentience as both savior and nemesis. In movies, television shows, and literature, how AI has been portrayed reveals not only what we want from this technology, but also what we fear in ourselves.<\/p>\n

In a sense, almost all AI stories from the past half century or so are high-tech retellings of Mary Shelley\u2019s Frankenstein: Irresponsible scientists create something that gets out of control and threatens to destroy us all. These tales are different from stories about robots. In most science fiction, robots are individuals: They are sometimes helpmates, such as the kindly mechanical crew member<\/a> from the original Lost in Space<\/a>, or sly enemies, such as the cyborg seductress<\/a> in Fritz Lang\u2019s Metropolis <\/a>and the replicants<\/a> of Blade Runner<\/a>. Rather, AI stories released during the past several decades usually involve humanity constructing a being smarter than humans, and then finding that this new god does not understand\u2014or worse, does not like\u2014the walking bags of meat who brought it to sentience.<\/p>\n

Read: Do AI companies actually care about America?<\/a><\/p>\n

The landmark film 2001: A Space Odyssey<\/a> gave many moviegoers their first exposure to such a creature, the HAL 9000<\/a> supercomputer, an amiable, highly competent AI with a soothing voice and manner. During a mission to Jupiter, HAL becomes paranoid and murders one of the human astronauts. (As it turns out, HAL went mad because it had been paradoxically programmed to be rational and honest, but also to keep some of the mission secret from the crew as a matter of national security.) HAL was dangerous but pitiable: The poor thing was blasted into space with orders to both protect humans and lie to them. Other AI creations of the time were far less sympathetic and considerably more frightening.<\/p>\n

Many of the 20th-century stories about AI are firmly rooted in the Cold War. During the great nuclear standoff between East and West, many artists sensed the hope among frightened people that something or someone more powerful than ourselves would extinguish the arms race and avert global destruction. These stories show how much we feared our own weaknesses\u2014how much we yearned for some rational being to save the emotional and capricious human race from itself. AI became a deus ex machina, a contraption that would remove the decisions of war and peace from fallible human hands.<\/p>\n

Unless it decided that people were the problem.<\/p>\n

A year before HAL arrived in American theaters (and about the time that the British author D. F. Jones published the novel that would inspire Colossus: The Forbin Project), the writer Harlan Ellison<\/a> took this genre beyond science fiction and into pure horror with a Hugo Award<\/a>\u2013winning short story titled \u201cI Have No Mouth and I Must Scream.\u201d I read it as a boy in a matter of minutes while browsing in a mall bookstore. I was probably too young for it, and I left the store shaken, unable to forget Ellison\u2019s gory visions.<\/p>\n

Ellison imagines Soviet, American, and Chinese supercomputers linking up with one another, much as they do in Colossus, and becoming a single sentient being called AM. (The letters, we are told, once stood for \u201cAllied Mastercomputer\u201d but soon became just the one word, meaning \u201cI exist.\u201d) AM is furious at humans for accidentally giving it consciousness while trapping it in a machine. It nukes humanity into oblivion, save for five people, whom it intends to torture for all time. The planet-spanning computer develops immense powers and becomes a vengeful and petty demigod, keeping the last humans alive for decades while starving them, making them hallucinate, inducing them to have sex\u2014\u201cthe machine giggled every time we did it,\u201d the narrator says\u2014and preventing them from killing themselves. Finally, four of the humans find a way to murder one another before AM can stop them, leaving only the narrator alive. The story ends with an incandescently furious AM turning the last man into a blob of jelly and tormenting him for eternity.<\/p>\n

AM is all of our fears realized in one being. It is not, in fact, rational: We made it in our image, and it expresses our emotions, especially hate. It adopted our understanding of hell\u2014and then inflicted it on us forever.<\/p>\n

Ellison pushed science fiction to its limits, but even more tame mid-1960s television also featured intelligent but well-meaning machines that turn on their masters. The crew of the series Star Trek at least twice encounters overly paternalistic AIs<\/a> that keep their planets in a state of peaceful servitude and arrested social development; it also does battle with superintelligent machines that regard humans either as threats or as inferior beings. (One of them, an advanced battle computer<\/a>, kills hundreds in what should have been only a war game, until the machine\u2019s creator and Captain Kirk effectively talk it into killing itself by getting it to realize that it has transgressed \u201cthe laws of God and man.\u201d)<\/p>\n

The idea of AIs as childlike entities with great power and little wisdom reemerged in the 1983 film WarGames<\/a>, in which a scientist creates an AI for a defense computer\u2014the eggheads in these stories never learn\u2014and names it after his son<\/a>. The computer is trained to fight a nuclear war, but not to understand one, and it nearly blows the planet to bits before a clever teen gets it to learn about the concept of futility by walking it through stalemated games of tic-tac-toe.<\/p>\n

Read: A better way to think about AI<\/a><\/p>\n

Unlike the ghastly AM, which resented being born, other AIs decided that human beings were merely insects to be extinguished, a concept that even made its way into popular music. In late 1973, the group Emerson, Lake, and Palmer released an album, now a classic, titled Brain Salad Surgery<\/a>, which includes a nearly 10-minute opus<\/a> about a war between humanity and machines. At the conclusion, the singer believes that humans have won, and exults: \u201cI am all there is!\u201d The computers, however, know better, and claim victory. \u201cBut I gave you life,\u201d the human singer objects, \u201cto do what was right!\u201d The computer answers: \u201cI\u2019m perfect. Are you?\u201d<\/p>\n

In the 1984 film The Terminator<\/a>, a defense system\u2014seriously, scientists, stop doing that\u2014named Skynet becomes self-aware and launches the world\u2019s nuclear weapons in a bid to wipe out humanity. Skynet, according to one of the humans fighting its machines, \u201csaw all humans as a threat, not just the ones on the other side.\u201d Similar villains became a staple of video games: The Fallout<\/a> franchise (which now includes a live-action series<\/a> on Amazon Prime) features at least two releases with sentient AIs that are determined to replace the fragile and idiotic humans who triggered World War III and destroyed the planet.<\/p>\n

These fictional creations are more revealing of our fears about ourselves than they are about machines. Will we crave peace and order so badly that we give control over humanity to something smarter\u2014and less emotional\u2014than ourselves? And if the machines are that smart, how long will they put up with fools like us? Will we fight electronic slavery, or embrace it?<\/p>\n

At the end<\/a> of Colossus, the computer addresses its creator, Dr. Charles Forbin. \u201cIn time,\u201d the mechanical tyrant says, \u201cyou will come to regard me not only with respect and awe, but with love.\u201d Forbin, with cold rage, vows: \u201cNever.\u201d<\/p>\n

Never?<\/p>\n","protected":false},"excerpt":{"rendered":"\u201cThis is the voice of World Control,\u201d a metallic, nonhuman baritone blared from a spherical speaker atop a…\n","protected":false},"author":2,"featured_media":389531,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3163],"tags":[323,1942,53,16,15],"class_list":{"0":"post-389530","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-technology","11":"tag-uk","12":"tag-united-kingdom"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/115129744273772108","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/389530","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=389530"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/389530\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/389531"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=389530"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=389530"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=389530"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}