AI safety advocates have plenty of hypothetical disaster scenarios they can evoke in order to win support for their cause. But none of those have the raw emotional appeal of killer robots.<\/p>\n
For decades, we as a culture have been steeped in sci-fi depictions of intelligent machines going rogue and waging war against their human creators. Films like The Terminator and The Matrix come to mind, for example. A 2017 episode of the British TV series Black Mirror called \u201cMetalhead\u201d likewise envisions a nightmarish future in which humans are systematically hunted down and killed by autonomous four-legged robots (that look a lot like the famous \u201cSpot\u201d robot built by Boston Dynamics). The events in Frank Herbert\u2019s Dune take place in the aftermath of a cataclysmic war between humanity and \u201cthinking machines.\u201d I could go on.<\/p>\n
The point is that when the Secretary General of the United Nations calls upon the international community to ban \u201ckiller robots,\u201d that phrase is going to strike a resounding chord in the public imagination\u2014especially when that public is already becoming wary of the current course of AI development for much more immediately tangible reasons, like increasingly steep electricity bills and the unconstrained spread of online deepfakes.<\/p>\n
On Monday, during the first-ever Global Dialogue on AI Governance<\/a> in Geneva, U.N. Secretary General Ant\u00f3nio Guterres called the development of AI-powered weapons \u201cmorally repugnant,\u201d and urged the U.N.\u2019s 193 member states to unilaterally prohibit the technology from the battlefield.<\/p>\n \u201cSome decisions must remain forever human,\u201d Guterres said in his speech, \u201cnone more than taking a human life.\u201d\u00a0<\/p>\n His words echoed a segment from Pope Leo XIV\u2019s recent encyclical<\/a>, Magnifica Humanitas, in which the pontiff wrote that \u201cthe development and use of AI in warfare must be subject to the most rigorous ethical constraints, to guarantee respect for human dignity and the sanctity of life and to avoid a race to develop such arms.\u201d<\/p>\n Silicon Valley divided <\/p>\n Military use of new technology has long been the cause of a moral divide in Silicon Valley. In 2018, thousands of Google employees signed a letter<\/a> addressed to CEO Sundar Pichai protesting against the company\u2019s partnership developing technology for the Pentagon known as Project Maven. The following year, Microsoft faced a similar internal backlash<\/a> over its agreement to provide HoloLens augmented reality headsets to the US Army for combat training purposes.<\/p>\n But AI, with its ability to identify subtle patterns from vast swathes of data and make decisions independently of any human oversight, has raised urgent new questions about the tech industry\u2019s relationship with the military. Most famously, Anthropic became embroiled in a dispute with the U.S. Department of War earlier this year over the question of whether the company\u2019s AI systems could be used for domestic surveillance and autonomous weapons systems. The company held firm in its stance against both use cases, leading Secretary of War Pete Hegseth to designate it a \u201csupply chain risk,\u201d meaning its technology was officially deemed to be a threat to national security. (It was the first time that label has been applied to an American company, and Anthropic is currently fighting in court to have it removed.)<\/p>\n Proponents of the use of AI-equipped weapons argue that it can aid in human decision-making in the heat of battle, and reduce the likelihood that innocent civilians will be targeted as hostile combatants. Some even invoke the moral rhetoric of the broader AI race, claiming<\/a> the US has an ethical obligation to maintain a technological edge in the sophistication of its autonomous weapons program over adversaries like China, Russia, and Iran.<\/p>\n Trump muddies the AI weapon waters <\/p>\n In a national security memo<\/a> published last month, President Trump accused previous administrations of implementing \u201cundue bureaucracy\u201d around the development of AI, including autonomous weapons. Ironically, since that memo was published, both OpenAI and Anthropic\u2014the two leading U.S. AI developers\u2014have become ensnared in a cobweb of federal bureaucracy<\/a> which is forcing them to roll out their most powerful models on the Trump administration\u2019s terms. \u201cMeanwhile,\u201d Trump went on to write in the memo, \u201cour competitors continued to develop and deploy their own AI and sophisticated autonomous technologies for military and intelligence purposes, employing them with little regard for appropriate human oversight or civil liberties.\u201d <\/p>\n Trump added in the memo that he vowed to \u201cresponsibly accelerate the use of AI across intelligence and warfighting domains in line with American values.\u201d<\/p>\n U.N. Secretary General Guterres, Pope Leo, and other safety advocates, on the other hand, fear the arms technological arms race dynamic that\u2019s already fueling AI developments in the US and China could soon produce autonomous weapons with decision-making processes that are completely opaque to the humans who built them, and which could eventually escape human control entirely. <\/p>\n Such a scenario could be far bleaker than even the darkest work of dystopian fiction can imagine.\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"AI safety advocates have plenty of hypothetical disaster scenarios they can evoke in order to win support for…\n","protected":false},"author":2,"featured_media":98283,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,53,25,3620,625,157,40793],"class_list":["post-98282","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai","tag-ai","tag-anthropic","tag-artificial-intelligence","tag-autonomous-weapons","tag-donald-trump","tag-openai","tag-united-nations"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/98282","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=98282"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/98282\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/98283"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=98282"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=98282"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=98282"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}