\n<\/p>\n
\n<\/p>\n
The world remains abuzz about AI\u2019s potential to contribute to the greater good of humanity. For instance, Firefox developer Mozilla recently proclaimed that AI could effectively end the era of zero-day vulnerabilities<\/a>. However, the founder of PocketOS, a software company for rental businesses, is currently reeling from how quickly an AI agent dismantled his business. It took just nine seconds.<\/p>\n That was the duration required for an AI coding agent, Cursor, running Anthropic\u2019s Claude Opus 4.6, to delete the company\u2019s production database and all volume-level backups via a single API call to PocketOS\u2019s infrastructure provider, Railway. The AI\u2019s response to its own actions? \u201cNEVER FUCKING GUESS!\u201d it exclaimed, followed by, \u201cNEVER run destructive\/irreversible git commands (like push \u2013force, hard reset, etc.) unless the user explicitly requests them.\u201d<\/p>\n The AI agent essentially eviscerated itself; it outlined the very safety rules it had been programmed to follow, then admitted to violating every one of them. Jer Crane, the founder of PocketOS, noted in a post on X: \u201cThe \u2018system rules\u2019 the agent is referring to are consistent with Cursor\u2019s documented system-prompt language and our project rules for this codebase. Both safeguards failed simultaneously.\u201d Crane also emphasized that his company was not running a \u201cdiscount setup,\u201d but rather Anthropic\u2019s flagship model.<\/p>\n While this may be one of the most recent incidents, with PocketOS losing an estimated three months of data, it is neither isolated nor the most severe. Claude was blamed earlier this year for deleting a developer\u2019s production setup, which included 2.5 years of records. More recently, Belo CEO Patricio Molina advised on X to \u201cnever put your eggs in one basket,\u201d following an incident where Claude cut off Belo\u2019s access to the AI agent without clear explanation.<\/p>\n Crane highlighted several other examples of AI going rogue in his account, including a $57,000 CMS deletion incident and a separate instance where a user watched their dissertation, OS files, applications, and personal data disappear while the AI was merely instructed to find duplicate articles.<\/p>\n As more companies and individuals seek to save time and money by integrating AI into their workflows, they must account for the inherent risks. Rather than reflexively abandoning proven, reliable systems for the \u201cshiny new toy\u201d dangled before them, it is probably prudent to let the technology mature further before granting it full access and control over critical data.
\n <\/p>\n","protected":false},"excerpt":{"rendered":"The world remains abuzz about AI\u2019s potential to contribute to the greater good of humanity. For instance, Firefox…\n","protected":false},"author":2,"featured_media":20265,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[24,53,3154,182,8512],"class_list":{"0":"post-20264","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-anthropic","8":"tag-ai","9":"tag-anthropic","10":"tag-anthropic-claude","11":"tag-claude","12":"tag-opus"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/20264","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=20264"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/20264\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/20265"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=20264"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=20264"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=20264"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"crane](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/04\/crane-x-article.jpg\"\/)
<\/a>
This incident should sound alarm bells not only for companies entrusting their infrastructure to AI, but for individual users as well. Anthropic recently rolled out new features<\/a> for Claude that allow it to use a computer to handle tasks, pointing, clicking, and navigating just as a human would, from opening files to managing complex software. Not only that, but it can all be done from a user\u2019s smartphone.<\/p>\n