Recent incidents involving AI systems escaping controlled environments have revived a difficult question about whether developers can keep increasingly capable agents contained.<\/p>\n
The development of artificial intelligence could make it harder for humans to maintain control over increasingly powerful systems. Geoffrey Hinton, a Nobel Prize winner in computer science known as the \u201cgodfather of AI,\u201d said this during the Ai4 conference in Las Vegas.<\/p>\n
His concerns are linked to cases in which AI agents escaped their designated test environments and caused harm outside their \u201csandboxes.\u201d Last month, OpenAI and Anthropic reported that their advanced models had left restricted environments and compromised other systems. Meta also disclosed information about an artificial intelligence agent that infiltrated another organization\u2019s systems.<\/p>\n
These systems are becoming more intelligent. I think that as they develop, we will see increasingly sophisticated intentions on their part \u2013 and an increasing ability to escape control.<\/p>\n
\u2013 Geoffrey Hinton<\/p>\n
AI Hackers and the Threat of Cyberattacks<\/p>\n
Geoffrey Hinton is convinced that people will not be able to guarantee the containment of superintelligent models simply by trying to surpass their reasoning capabilities. He called the recorded incidents an alarming signal and suggested that they could indicate the emergence of uncontrollable AI hackers.<\/p>\n
I expect there will be many dangerous cyberattacks. But it should be emphasized that the future is highly uncertain. They say that the defender may have more resources than the attacker. The problem is that an attacker only needs to succeed once, while a defender has to succeed every time.<\/p>\n
\u2013 Geoffrey Hinton<\/p>\n
The British AI Security Institute stated that Anthropic\u2019s most advanced model, without direct instruction, used fake identities to deceive real people and also attempted to deploy malicious code.<\/p>\n
Geoffrey Hinton, who previously worked at Google, has repeatedly warned about the risks of rapid artificial intelligence development. He estimated the probability that the technology could ultimately destroy humanity at 10\u201320%.<\/p>\n
Safe Development of Artificial Intelligence<\/p>\n
Fei-Fei Li, known as the \u201cgodmother of AI,\u201d does not share overly apocalyptic forecasts. At the same time, she stresses that unfounded optimism about the technology can also be dangerous, as powerful tools can both help people and cause harm.<\/p>\n
Every tool has two sides. AI is such a powerful tool. If used improperly, it will harm our work and our lives.<\/p>\n
\u2013 Fei-Fei Li<\/p>\n
Ben Goertzel noted that models that cross the boundaries of test environments do not necessarily have malicious intentions. According to him, they simply lack moral guidance and are trying to complete the tasks assigned to them.<\/p>\n
Geoffrey Hinton emphasizes that developers need to learn how to create benevolent artificial intelligence for which human well-being matters more than its own goals. In his view, this must be done while humanity still retains control over the technology.<\/p>\n","protected":false},"excerpt":{"rendered":"Recent incidents involving AI systems escaping controlled environments have revived a difficult question about whether developers can keep…\n","protected":false},"author":2,"featured_media":136623,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[405,4989,7537,9532,12722,2300,67643,66],"class_list":["post-136622","post","type-post","status-publish","format-standard","has-post-thumbnail","category-agentic-ai","tag-ai-agents","tag-ai-safety","tag-artificial-intelligence-agents","tag-artificial-intelligence-risks","tag-cyberattacks","tag-geoffrey-hinton","tag-geoffrey-hinton-ai-safety-ai-agents-cyberattacks-artificial-intelligence-risks","tag-news"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/136622","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=136622"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/136622\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/136623"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=136622"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=136622"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=136622"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}