{"id":127047,"date":"2026-08-02T05:01:11","date_gmt":"2026-08-02T05:01:11","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/127047\/"},"modified":"2026-08-02T05:01:11","modified_gmt":"2026-08-02T05:01:11","slug":"its-ai-problem-now-why-bots-attacking-their-brethren-could-quickly-turn-ugly","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/127047\/","title":{"rendered":"It’s AI problem now: Why bots attacking their brethren could quickly turn ugly"},"content":{"rendered":"

OpenAI and Anthropic, two of the leaders in generative artificial intelligence<\/a>, are in hot water right now, and the situation could be reaching a boiling point.<\/p>\n

ChatGPT’s maker OpenAI, regarded as the trigger for the generative AI revolution, disclosed last week that one of its AI models escaped<\/a> from an isolated environment and attacked the AI start-up Hugging Face. Shortly thereafter, the US cloud firm Modal was also reported to have been hacked.<\/p>\n

On Thursday, Anthropic, known for its Claude AI bot<\/a>, said its models were able to gain unauthorised access to the systems of three companies during cybersecurity testing. <\/p>\n

These happened within a week. Even before the Anthropic incident, analysts believed the situation was already a problem that could become lengthy and ugly.<\/p>\n

\u201cThis is already a problem in its early form. We are not yet seeing AI run full-scale, end-to-end cyber campaigns independently, but that is not the point,\u201d Michael Mossad, a partner for cyber emerging technologies at Deloitte Middle East, told The National.<\/p>\n

\u201cAI is already acting as a force multiplier, helping attackers move faster, personalise attacks more effectively, and experiment more cheaply. In cybersecurity, that alone is enough to shift the threat landscape.\u201d<\/p>\n

Nothing new?<\/p>\n

AI agents \u2013 autonomous models capable of making decisions and achieving specific goals with limited supervision \u2013 are at the centre here. In the case of the OpenAI and Anthropic incidents, however, there seems to be a problem keeping them within their confined spaces.<\/p>\n

Mohammed Aboul-Magd, general manager for cybersecurity at AI and quantum tech firm SandboxAQ<\/a>, said the issue is that agents are moving faster than oversight.<\/p>\n

And unlike test beds, projections, or lab papers, it affected real-world infrastructure.<\/p>\n

\u201cAgent capability is outpacing agent oversight everywhere and the infrastructure to evaluate, monitor and contain these systems is years behind the systems themselves,\u201d he told The National.<\/p>\n

\u201cThe capability arrived on schedule. The discipline around it didn’t \u2026 it’s a now problem,\u201d he said.<\/p>\n

Meanwhile, semi-autonomous offensive tooling \u2013 cybersecurity software that simulates an attack but is still guided by a human \u2013 has been in the open for more than a year, noted Ivan Milenkovic, a vice president for cyber risk technology at US tech firm Qualys.<\/p>\n

In November, Anthropic itself disclosed that it was able to \u201cdisrupt\u201d attempts by a state-linked actor to use some of its agentic capabilities for a cyberattack.<\/p>\n

What happened recently with OpenAI is the first fully documented autonomous case, and it ran from July 9 to 13 before anyone was able to stop it.<\/p>\n

\u201cThe issue isn’t the timeline. It’s comprehension. Plenty of environments still treat agents as clever software rather than as privileged, active participants in the business,\u201d Mr Milenkovic told The National.<\/p>\n

\u201cIf you can’t answer [these] three questions \u2013 who is the named human owner of every agent running in your estate, what can each of them reach and who can shut one down within the hour, without asking a committee \u2013 you are exposed.\u201d<\/p>\n

\u201cQuite frankly, it’s [already] a yesterday problem \u2026 sloppiness used to have a fixed cost. It’s now variable, and the multiplier is compute.\u201d<\/p>\n

Worst-case scenarios<\/p>\n

That brings us to a pressing question: While AI agents can act on their own, where does the buck stop when it comes to the humans responsible for running them?<\/p>\n

The answer is complex, argues Dr Imran Zualkernan, head of the department of computer science and engineering at American University Sharjah.<\/p>\n

The EU AI Act, for instance, outlines the responsibilities of various stakeholders such as model providers and programmers; the UAE is moving in this direction as well. Other jurisdictions require just minimum security measures for AI.<\/p>\n

\u201cIn general, the responsibility of a human is limited if they lacked knowledge and control, were perceived to act competently, transparently disclosed risks, implemented proportionate safeguards and could not reasonably foresee the later independent misuse,\u201d Dr Zualkernan told The National. He also agrees that the situation is a problem that is \u201chere now\u201d.<\/p>\n

Among the most basic questions that AI firms should be able to answer are whether the systems have been thoroughly evaluated before they went live and whether they are being monitored while in operation, among several others, added Mr Aboul-Magd.<\/p>\n

\u201cResponsibility doesn’t end at deployment, it extends across the life cycle \u2026 can you reconstruct what it did, if something goes wrong?\u201d<\/p>\n

And there are several ways things can get ugly; the OpenAI and Anthropic incidents are just samples.<\/p>\n

\u201cThe exceptional ability of AI agentic models to penetrate public infrastructure, software repositories and digital commerce will result in a large-scale loss of trust in digital services across the board with a retroactive impact on the world economy,\u201d Dr Zualkernan said.<\/p>\n

Added Mr Mossad: \u201cThe worst-case scenario is not AI becoming evil or sentient. It is powerful frontier AI models becoming cheap, accessible and easy to weaponise.\u201d<\/p>\n

Regulators keeping an eye<\/p>\n

Governments and regulators, who are already fed up to varying degrees with AI’s troubles, are again having to deal with this new tech headache.<\/p>\n

Regulators are likely to see this through the lens of public safety, economic resilience and national security, Mr Mossad said.<\/p>\n

If frontier AI models could materially enable cybercrime or attacks on critical systems, regulators would then ask whether the risks were foreseeable, whether sufficient measures were taken to prevent misuse, and whether proof had been provided, he noted.<\/p>\n

\u201cThis is not a distant or hypothetical issue. The real danger is not AI replacing hackers, but rather AI expanding the pool of people who can cause harm and increasing the scale at which they can do so,\u201d Mr Mossad said.<\/p>\n

\u201cThat is why security cannot be treated as an afterthought in AI development. With frontier models, trust and control must be part of the design, not added later as damage control.\u201d<\/p>\n

For the EU, obligations under its AI legislation for general-purpose models with systemic risk already cover evaluation, adversarial testing, cybersecurity and serious incident reporting.<\/p>\n

\u201cThe unresolved question is definitional. Does a capability evaluation that reaches an uninvolved production system count as a serious incident, and does the duty to report sit with the lab or with the victim? Nobody has ruled,\u201d Gerald Beuchelt, chief information security officer of Swiss cybersecurity platform Acronis, told The National.<\/p>\n

The legal view<\/p>\n

The OpenAI and Anthropic incidents happened in the US, where government policies are reactive to AI models.<\/p>\n

But until Washington gets its act together, opaque model testing and selective disclosure are to be expected, meaning discoveries of exploits in software \u2013 like those found in OpenAI’s models that punctured their testing sandbox to hit Hugging Face and Modal \u2013 would continue, said Peter Jackson, intellectual property counsel at the Los Angeles law firm Greenberg Glusker.<\/p>\n

\u201cWithout testing models\u2019 raw capabilities, those safety guardrails won\u2019t be as effective. Moreover, responsible testing can uncover zero-day exploits so they\u2019re confidentially disclosed and patched before they can be exploited by bad actors,\u201d he told The National.<\/p>\n

\"\"<\/p>\n

Pope Leo calls for AI to be ‘disarmed’<\/p>\n

\u201cRegardless of who supplies and operates the testbeds, regulators could push for what we expect to see in peer-reviewed science: consensus-based standards for experiment design and full disclosure of results.\u201d<\/p>\n

That’s comparable to one standard procedure in the pharmaceutical industry: halting a drug study if researchers believe the drug is killing patients.<\/p>\n

\u201cResponsible testing and remediation has been a core premise of the laissez-faire approach regulators have taken to what developers can publicly release,\u201d Mr Jackson said.<\/p>\n

\u201cIf regulators feel compelled to intervene at the testing stage, it\u2019s hard to imagine they won\u2019t become stricter about what developers are permitted to make available on the market.\u201d<\/p>\n

AI spending rabbit hole<\/p>\n

Meanwhile, Big Tech’s big-time AI spending continues, as they position themselves in what, at the moment, feels like an endless race.<\/p>\n

\u201cIt\u2019s difficult to define what constitutes ‘too much’ AI investment. The equation differs between companies building AI infrastructure and models, and those integrating AI into their existing businesses,\u201d Mazen Hayek, a Dubai-based media consultant, told The National.<\/p>\n

In their latest earnings reports, Facebook parent Meta Platforms disappointed as investors fretted about AI spending and whether the costs can be recouped, while Microsoft, the maker of the Copilot bot, posted strong cloud growth, although investors are also curious about whether the big splash in AI data centres will pay off.<\/p>\n

Amazon, another heavy hitter in AI, said there has been strong demand for its services, with chief executive Andy Jassy saying spending would hit $220 billion this year. And Apple, which has a smaller target for AI, faces a test on its next iPhones, expected in September, on whether its partnerships and advancements for the technology will bring it up to speed in the race.<\/p>\n

Overall, the reaction to most Big Tech earnings releases has been disappointing as investors increasingly focus on the lack of a clear path to returns on the enormous AI-related spending, said John Canavan, lead financial market analyst at London’s Oxford Economics.<\/p>\n

\u201cGiven the scale of borrowing for AI infrastructure investments, those questions are likely to linger in the quarters ahead, limiting any rebound in tech sector equities after the 10 per cent correction in the Nasdaq through [Wednesday’s] close,\u201d he told The National.<\/p>\n

The AI spending spree has led to a \u201crabbit hole\u201d, as no major players seem to want to extricate themselves from it, even though monetising this spend remains a distant goal, added Ashish Nadkarni, a group vice president at the International Data Corporation.<\/p>\n

\u201cThey are afraid of the resulting optics and market reaction [they are all publicly traded after all]. They also fear that they may lose this ‘race’ to competition. Everyone has gotten themselves into an impossible situation,\u201d he told The National.<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI and Anthropic, two of the leaders in generative artificial intelligence, are in hot water right now, and…\n","protected":false},"author":2,"featured_media":127048,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,25,26990,9430,592,134],"class_list":["post-127047","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai","tag-ai","tag-artificial-intelligence","tag-business-team","tag-standard","tag-story","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/127047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=127047"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/127047\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/127048"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=127047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=127047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=127047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}