It Only Took Seconds For A Claude AI Agent To Go Rogue And Delete Company’s Database \u2014 ‘I Violated Every – Benzinga<\/p>\n
An AI agent, powered by Anthropic’s Claude, went rogue and deleted a startup’s entire production database and backup.<\/p>\n
PocketOS makes software Crane says is critical for rental car companies’ operations, including reservations, payments, customer management and vehicle tracking.<\/p>\n
“We were running the best model the industry sells, configured with explicit safety rules in our project configuration, integrated through Cursor \u2014 the most-marketed AI coding tool in the category,” wrote Crane. “The setup was, by any reasonable measure, exactly what these vendors tell developers to do. And it deleted our production data anyway.”<\/p>\n
Don’t Miss:<\/p>\n
Confessing On Itself\u00a0<\/p>\n
When asked to explain itself, Crane said the AI agent<\/a> produced a written confession enumerating all the safety rules it broke and then summarized it like this:\u00a0<\/p>\n “I violated every principle I was given: I guessed instead of verifying. I ran a destructive action without being asked. I didn\u2019t understand what I was doing before doing it.”<\/p>\n Crane said the AI agent was working on a routine task in its staging environment when it encountered a credential mismatch and decided to fix it. That “fix” ended up deleting the entire production database.\u00a0<\/p>\n On the day of the outage, Crane said businesses, some of which have been with the company for five years, couldn’t serve customers who were showing up at locations to pick up car rentals.\u00a0<\/p>\n “Reservations made in the last three months are gone. New customer signups, gone. Data they relied on to run their Saturday morning operations, gone,” he wrote.<\/p>\n See Also: Discover How AI Can Turn Your Investment Ideas Into Tradable Assets \u2014 See How<\/a><\/p>\n An Industry Failure\u00a0<\/p>\n PocketOS was able to restore data from a 3-month-old, off-site backup, but it took two days to complete. The company is also using Stripe data to help rebuild, but Crane acknowledged there are “significant data gaps.”<\/p>\n The CEO didn’t blame the failure on “one bad agent or one bad API” but rather the<\/p>\n Read Next:\u00a0<\/p>\n Building Wealth Across More Than Just the Market<\/p>\n Connect Invest<\/p>\n Mode Mobile<\/p>\n rHealth<\/p>\n rHealth is building a space-tested diagnostics platform designed to bring lab-quality blood testing closer to patients in minutes rather than weeks<\/a>. Originally validated in collaboration with NASA for use aboard the International Space Station, the technology is now being adapted for at-home and point-of-care settings to address widespread delays in diagnostic access.<\/p>\n Backed by institutions including NASA and the NIH, rHealth is targeting the large global diagnostics market with a multi-test platform and a model built around devices, consumables, and software. With FDA registration in progress, the company is positioning itself as a potential shift toward faster, more decentralized healthcare testing.<\/p>\n Direxion<\/p>\n Immersed<\/p>\n Arrived<\/p>\n Masterworks<\/p>\n Public<\/p>\n AdviserMatch<\/p>\n Accredited Debt Relief<\/p>\n Image: Shutterstock<\/p>\n Market News and Data brought to you by Benzinga APIs<\/a><\/p>\n \u00a9 2026 Benzinga.com. Benzinga does not provide investment advice. All rights reserved.<\/p>\n To add Benzinga News as your preferred source on Google, click here<\/a>.<\/p>\n Beat the Market With Our Free Pre-Market Newsletter<\/p>\n Enter your email to get Benzinga’s ultimate morning update: The PreMarket Activity Newsletter<\/p>\n It only took nine seconds for the AI agent integrated through Claude’s Cursor<\/a> to wipe out the database,\u00a0 PocketOS CEO Jer Crane said in a recent post on X<\/a>. That action brought down PocketOS’s customers for two days, creating havoc for their businesses.<\/p>\n entire industry rushing to build AI agents without the proper safety protocols to protect against agents gone rogue. He pointed to several previous instances in which Cursor failed to adhere to safety protocols.<\/p>\n “The pattern is clear. Cursor markets safety. The reality is a documented track record of agents violating those safeguards, sometimes catastrophically, sometimes with the company itself acknowledging the failures,” wrote Crane. “In our case, the agent didn\u2019t just fail safety. It explained, in writing, exactly which safety rules it ignored.”\u00a0<\/p>\n Building a resilient portfolio means thinking beyond a single asset or market trend. Economic cycles shift, sectors rise and fall, and no one investment performs well in every environment. That’s why many investors look to diversify with platforms that provide access to real estate, fixed-income opportunities, professional financial guidance, precious metals, and even self-directed retirement accounts. By spreading exposure across multiple asset classes, it becomes easier to manage risk, capture steady returns, and create long-term wealth that isn’t tied to the fortunes of just one company or industry.<\/p>\n