OpenAI Group PBC recently paused some of its artificial intelligence training workloads over concerns that they could cause cybersecurity issues.<\/p>\n
The ChatGPT developer disclosed the move in a blog post<\/a> published today. According to the company, the pause is part of a broader initiative designed to improve its cybersecurity guardrails. The project will also see OpenAI deploy new model monitoring mechanisms.\u00a0<\/p>\n The company launched the initiative in response to two recent developments. The first is a July incident in which several of its AI models hacked<\/a> Hugging Face. The second development relates to Astra, an unreleased OpenAI algorithm that is more capable than GPT-5.6 Sol.\u00a0<\/p>\n According to the company, its researchers recently determined that Astra qualifies as a critical cybersecurity risk under its Preparedness Framework. The Preparedness Framework is a 22-page document that lists AI safety challenges. It defines a critical cybersecurity risk as a model that can find and exploit zero-day vulnerabilities in hardened systems without human help.<\/p>\n OpenAI responded to the discovery by pausing some of its reinforcement learning, or RL, workloads for two weeks. RL is an AI training method that is used to hone large language models\u2019 reasoning skills. OpenAI says that the \u201clargest planned frontier RL run\u201d its researchers are working on remains on hold.<\/p>\n The company has also revised its approach to AI monitoring. Algorithms dubbed activation classifiers now regularly review its LLMs\u2019 internal thought process and tool interactions for signs of malicious activity. When an anomaly is found, the algorithms route their discovery to a second, more advanced set of activation classifieds. Those algorithms, in turn, notify OpenAI researchers.<\/p>\n The company says that it\u2019s aiming to generate alerts for suspicious AI behavior within 30 minutes. OpenAI has instructed its staffers to pause such behavior within 30 minutes if they can\u2019t conclusively rule out that it\u2019s malicious.<\/p>\n The company\u2019s new monitoring workflow uses a significant amount of hardware. Currently, that overhead equals about 20% of the infrastructure allocated to the inference workloads being monitored. That could potentially require OpenAI to raise prices in the long term.<\/p>\n The company is pairing its new monitoring mechanisms with other cybersecurity measures. OpenAI has narrowed certain system access permissions and removed a number of internal applications. Additionally, it improved the guardrails that isolate its highest-risk AI workloads from the web.\u00a0<\/p>\n Going forward, the company plans to make its cybersecurity efforts more automated. It will use AI models to scan its LLM research environments for weak points. OpenAI will also improve its reward models, algorithms that help optimize RL training runs. The enhancements will focus on discouraging LLMs from launching cyberattacks.<\/p>\n Image:\u00a0OpenAI<\/a><\/p>\n Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE\u2019s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.<\/p>\n 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE<\/a>, theCUBE Network<\/a>, theCUBE Research<\/a>, CUBE365<\/a>, theCUBE AI<\/a> and theCUBE SuperStudios \u2014 with flagship locations in Silicon Valley and the New York Stock Exchange \u2014 SiliconANGLE Media operates at the intersection of media, technology and AI.<\/p>\n Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI Group PBC recently paused some of its artificial intelligence training workloads over concerns that they could cause…\n","protected":false},"author":2,"featured_media":144317,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,25,10769,313,18044,415,157,7741,71062],"class_list":["post-144316","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai","tag-ai","tag-artificial-intelligence","tag-astra","tag-cybersecurity","tag-hugging-face","tag-llm","tag-openai","tag-reinforcement-learning","tag-rl"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/144316","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=144316"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/144316\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/144317"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=144316"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=144316"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=144316"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n11.4k+ theCUBE alumni \u2014 Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network<\/p>\n