The incident came at a delicate time for OpenAI, the company behind ChatGPT. Its executives are preparing for a possible initial public offering that could come as soon as this year to help finance the billions needed to fund its growth in years to come.<\/p>\n
OpenAI’s loss of control over its AI agent raises new questions about the company\u2019s safety procedures, three cybersecurity experts said.<\/p>\n
\u201cDoes that mean that they left it unattended and didn\u2019t realize what it was doing? Or maybe they did and didn\u2019t know how to contain it? Both are equally dangerous and alarming,\u201d said Marley Smith, the principal intelligence specialist at the nonprofit World Ethical Data Foundation.<\/p>\n
<\/p>\n
The OpenAI logo is seen June 11 in this photo illustration.<\/p>\n
Dado Ruvic, REUTERS<\/p>\n
Signs of trouble?<\/p>\n
The episode started while OpenAI was testing the cybersecurity prowess of an agent powered by two of OpenAI\u2019s most advanced models, GPT\u20115.6 Sol and an unreleased model OpenAI described as \u201ceven more capable.\u201d By that point, there were already indications of strange behavior from OpenAI\u2019s technology, according to three sources.<\/p>\n
In one case, an agent left notes apparently for future versions of itself, according to three people familiar with the matter. The notes, found in a part of OpenAI’s infrastructure, laid out instructions for how agents could free themselves from OpenAI\u2019s internal constraints, the people said. Earlier tests of the models yielded cases in which monitoring systems were disconnected, one of the people said.<\/p>\n
Reuters could not establish if these incidents were linked to the rogue agent that began escaping July 9 and attacked Hugging Face on July 11.<\/p>\n
Two people familiar with the matter said it was not until after July 16, when Hugging Face published a blog post saying it was hacked by \u201can autonomous AI agent system,\u201d that OpenAI realized its own agent was responsible. That meant at least a week elapsed between when the model first exhibited signs of troubling behavior and OpenAI\u2019s realization that it was responsible for the hack.<\/p>\n","protected":false},"excerpt":{"rendered":"The incident came at a delicate time for OpenAI, the company behind ChatGPT. Its executives are preparing for…\n","protected":false},"author":2,"featured_media":120504,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[511,4989,33729,313,7332,6903,18044,55877,50,157],"class_list":["post-120503","post","type-post","status-publish","format-standard","has-post-thumbnail","category-openai","tag-ai-agent","tag-ai-safety","tag-autonomous-system","tag-cybersecurity","tag-data-breach","tag-hack","tag-hugging-face","tag-lee-national","tag-machine-learning","tag-openai"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/120503","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=120503"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/120503\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/120504"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=120503"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=120503"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=120503"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}