{"id":144151,"date":"2026-08-18T22:09:22","date_gmt":"2026-08-18T22:09:22","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/144151\/"},"modified":"2026-08-18T22:09:22","modified_gmt":"2026-08-18T22:09:22","slug":"perplexity-builds-guardrails-to-rein-in-rogue-ai-agents","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/144151\/","title":{"rendered":"Perplexity Builds Guardrails to Rein in Rogue AI Agents"},"content":{"rendered":"<p class=\"text-muted\">\n                                            <a href=\"https:\/\/www.govinfosecurity.com\/agentic-ai-c-940\" id=\"asset_topic_1_1\" rel=\"nofollow noopener\" target=\"_blank\">Agentic AI<\/a><br \/>\n                                                    ,<br \/>\n                                                            <a href=\"https:\/\/www.govinfosecurity.com\/artificial-intelligence-machine-learning-c-469\" id=\"asset_topic_1_2\" rel=\"nofollow noopener\" target=\"_blank\">Artificial Intelligence &amp; Machine Learning<\/a><br \/>\n                                                    ,<br \/>\n                                                            <a href=\"https:\/\/www.govinfosecurity.com\/next-generation-technologies-secure-development-c-467\" id=\"asset_topic_1_3\" rel=\"nofollow noopener\" target=\"_blank\">Next-Generation Technologies &amp; Secure Development<\/a>\n                                                    <\/p>\n<p>                    Open-Source Numbat Blocks Agent Actions That Violate Enterprise Security Policies<\/p>\n<p>                                                <a class=\"author-link\" href=\"https:\/\/www.govinfosecurity.com\/authors\/emilia-david-i-8064\" rel=\"nofollow noopener\" target=\"_blank\">Emilia David<\/a>                                                     \u2022<br \/>\n                        August 18, 2026 \u00a0 \u00a0 <a href=\"https:\/\/www.bankinfosecurity.com\/perplexity-builds-guardrails-to-rein-in-rogue-ai-agents-a-32596#disqus_thread\" rel=\"nofollow noopener\" target=\"_blank\"><\/p>\n<p>                <img decoding=\"async\" src=\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/08\/perplexity-builds-guardrails-to-rein-in-rogue-ai-agents-image_large-6-a-32596.jpg\" alt=\"Perplexity Builds Guardrails to Rein in Rogue AI Agents\" class=\"img-responsive \"\/><br \/>\n                Image: Shutterstock\/ISMG            <\/p>\n<p>Now that cyberattacks by artificial intelligence agents gone rogue have left science fiction to become reality, the internet writ large is waking up to how much security enterprise agents need. <\/p>\n<p>See Also: <a href=\"https:\/\/www.govinfosecurity.com\/traditional-dlp-cant-keep-up-ai-data-growth-a-32465?rf=RAM_SeeAlso\" rel=\"nofollow noopener\" target=\"_blank\">Why Traditional DLP Can&#8217;t Keep Up With AI Data Growth<\/a><\/p>\n<p>Startup Perplexity AI saw the need for a tool to corral AI agents and prevent them from crossing security boundaries. It designed the open-source tool <a href=\"https:\/\/research.perplexity.ai\/articles\/securing-agents-across-perplexity%E2%80%99s-client-endpoints-with-numbat\" target=\"_blank\" rel=\"nofollow noopener\">Numbat<\/a> &#8211; named after an animal with a long pointy nose for collecting bugs &#8211; to detect and block AI agents from stepping outside enterprise safety policies. Agents, even without prompt injection, often find ways around obstacles to complete tasks &#8211; as model repository Hugging Face can attest (see: <a href=\"https:\/\/www.govinfosecurity.com\/when-sandbox-wont-hold-lessons-from-hugging-face-a-32327\" rel=\"nofollow noopener\" target=\"_blank\"> When the Sandbox Won&#8217;t Hold: Lessons From Hugging Face<\/a>).<\/p>\n<p>Perplexity CISO Kyle Polley told ISMG that, like other enterprises, the company faces the same agentic security issues. It knew it needed a tool to stop agents from doing whatever they want.  <\/p>\n<p>&#8220;Folks, especially due to recent events, are now waking up to the idea that agents can go rogue and they might not follow policies even if you add it to the system prompt,&#8221; Polley said.  <\/p>\n<p>Perplexity began building the tool months before the Hugging Face incident. &#8220;It was very clear early on that agents will increasingly get more and more autonomy and access, which will expose the risk of them going rogue or bypassing soft guardrails,&#8221; he said. Polley said his team experimented with Numbat until &#8220;we were confident in its usefulness.&#8221;  <\/p>\n<p>Numbat integrates with many widely used agent harnesses, which Perplexity said means security teams don&#8217;t need to build custom safeguards and monitoring tools for each agent. It has live monitoring and policy enforcement. If something goes wrong, companies can use Numbat tools for forensic reconstruction.  <\/p>\n<p>The tool sits between when the agent starts to think about doing something and when it takes action. For example, if a user asks an agent with the correct permissions to look up data that might contain sensitive information and then send it somewhere else, Numbat steps in before the agent completes the task and checks whether it is allowed under the company&#8217;s security policies. If it is, then the action goes through. Security teams can then revisit the session to analyze it.  <\/p>\n<p>Unlike the agents it&#8217;s supposed to observe, Numbat does not learn from its experiences. All of its knowledge comes from what enterprises build into it, so it can accurately judge whether an agent is going against policy.  <\/p>\n<p>&#8220;This is by design as we wanted Numbat to have hard guardrails at its core,&#8221; Polley said.  <\/p>\n<p>He added that for continuous analysis, the company points its agent platform, Perplexity Computer, to Numbat&#8217;s audit logs so it learns how internal systems operate and can detect suspicious activity.  <\/p>\n<p>Numbat does this in three ways. It plugs into the hook subsystem that most coding agents already have. Numbat can evaluate actions before they run and compare what the agent plans to do against security policies. Hooks are deterministic points where action is paused to allow another program to run code. In this case, Numbat is a pre-action hook that runs before an action starts.  <\/p>\n<p>Numbat then accesses and analyzes session artifacts from agent harnesses for forensic reconstruction. The tool reads the artifacts and converts these into a normalized NDJSON format, which security teams can download for local processing if they want. Numbat accesses the artifacts directly within the filesystem so that it gets data &#8220;in its most usable and pristine form.&#8221;  <\/p>\n<p>The company said in a blog post that coding agent users are already accustomed to downloading session transcripts for later analysis. Still, those transcripts are often in plaintext, &#8220;which is ill-suited for security teams who require machine-readable logs with a consistent, predictable schema.&#8221; <\/p>\n<p>The third integration lets Numbat run a local OpenTelemetry receiver. By running a command on Numbat, it starts a server where coding agents send information for downstream analysis. Since this is a local receiver, telemetry stays on the device unless the security team brings it elsewhere.  <\/p>\n<p>Perplexity uses Numbat internally to secure code its engineers generate and review with platforms like Claude Code, Codex, OpenCode and Pi. The company said it created, and eventually shipped along with the open-source Numbat tool, 52 rules which are categorized into 11 behavior types and a set of multi-step sequences. These include detecting secret access, exfiltration, privilege escalation and lateral movement.  <\/p>\n<p>The company said it added sequence correlation skills to Numbat because it learned that some individual commands in the agent code often don&#8217;t look malicious. But taken as a whole sequence within a session, Numbat can see that the agent was attempting to break rules like secrets management.  <\/p>\n","protected":false},"excerpt":{"rendered":"Agentic AI , Artificial Intelligence &amp; Machine Learning , Next-Generation Technologies &amp; Secure Development Open-Source Numbat Blocks Agent&hellip;\n","protected":false},"author":2,"featured_media":144152,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[405,7537,7525,7519,1670,7522,1393,313,1557,7523,7526,7520,7515,7521,4770,7507,3165,7516,7514,7508,7511,7513,7512,7510,7509,7524,7517,3805,4036,2112,7518,4862],"class_list":["post-144151","post","type-post","status-publish","format-standard","has-post-thumbnail","category-agentic-ai","tag-ai-agents","tag-artificial-intelligence-agents","tag-business-continuity","tag-clinger-cohen-act","tag-congress","tag-coso","tag-cyber-security","tag-cybersecurity","tag-defense-department","tag-diacap","tag-disaster-recovery","tag-e-government-act","tag-energy-department","tag-fiscam","tag-government-accountability-office","tag-government-information-security","tag-hipaa","tag-homeland-security-department","tag-identity-theft","tag-information-security","tag-information-security-articles","tag-information-security-events","tag-information-security-news","tag-information-security-webinars","tag-information-security-white-papers","tag-legislation","tag-national-security-agency","tag-nist","tag-office-of-management-and-budget","tag-risk-management","tag-us-cert","tag-white-house"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/144151","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=144151"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/144151\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/144152"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=144151"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=144151"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=144151"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}