Researchers at the University of Toronto say they have found a way to use artificial intelligence to create a dangerous computer \u201cworm\u201d capable of targeting any known flaw in the world\u2019s computers and quickly spreading mayhem throughout the internet.<\/p>\n
The computer scientists said in a paper published on Tuesday night that this program could be built and that a prototype they had created spread across a test network with no human intervention.<\/p>\n
The researchers kept their test network isolated from the public internet. They also redacted some details from the paper describing how they built the worm so that hackers would not be able to use the paper as a blueprint for attacks.<\/p>\n
But their work is likely to raise fears that A.I. is leading to a new era of computer hacking that will be difficult to defend against. It also adds to growing evidence that advances in A.I. are creating risks to computer networks that would have been hard to imagine just a few years ago.<\/p>\n
The A.I. company Anthropic said in April that its latest technology, Claude Mythos, was too powerful to share with the public because hackers could use it to exploit security holes in computer networks faster than they ever could before.<\/p>\n
Anthropic limited the release of the technology to about 40 organizations that maintain critical computer infrastructure so they could use the system to patch security vulnerabilities<\/a> before hackers took advantage of them.<\/p>\n A week later, OpenAI, Anthropic\u2019s chief rival, said it was limiting the release of similar technology<\/a>. OpenAI shared its new system with hundreds of organizations before expanding the release to thousands of partners in the weeks that followed.<\/p>\n (The New York Times sued<\/a> OpenAI and Microsoft in 2023, claiming copyright infringement of news content related to A.I. systems. The two companies have denied those claims.)<\/p>\n The paper from the University of Toronto adds a new twist to A.I. fears. Because the A.I. technology that powered the worm was \u201copen source\u201d or \u201copen weight\u201d \u2014 meaning it has been freely shared on the internet<\/a> \u2014 no one can restrict how it is used. The proverbial genie is out of the bottle.<\/p>\n \u201cYou have to have a perfectly secure system to defend against this \u2014 and we know that is not currently feasible,\u201d said Nicolas Papernot, a professor of computer engineering at the University of Toronto who led the team that built and tested the prototype.<\/p>\n Dr. Papernot and his team, which published the paper on his lab\u2019s website, were able to create what is essentially an A.I.-powered version of the computer worms that hackers started releasing onto the internet two decades ago. Unlike other kinds of computer viruses, worms spread from machine to machine on their own, without help from humans.<\/p>\n With names like SQL Slammer, Conficker and Stuxnet, each of these self-replicating software programs exploited a specific vulnerability in computers, taking control of millions of machines, stealing their data, deleting their files and generally wreaking havoc.<\/p>\n After a decade of attacks, many computer users learned to quickly patch their most glaring vulnerabilities. But the threat never went away. In 2017, another worm, WannaCry, targeted another major flaw in the world\u2019s machines and infected over 300,000 machines in 150 countries, taking their data hostage and demanding bitcoin ransom payments.<\/p>\n The prototype built by the Toronto researchers takes this kind of self-replicating worm a step further. It can rapidly spread across a network by tailoring a new attack for each machine it encounters. As Dr. Papernot described it, the worm could \u201creason<\/a>\u201d through new attack strategies.<\/p>\n \u201cThis makes it significantly more difficult to stop the spread of malware,\u201d he said. \u201cThere is no longer a single software fix you can apply to the devices to protect them from the worm.\u201d<\/p>\n The worm could run on computers that use either the Windows or the Linux operating system. And although the worm, because of its complexity, cannot operate without finding a more powerful machine, it could attack less powerful machines on the same network, including laptops, printers and cameras.<\/p>\n Security experts are not surprised that A.I. can tailor attacks. Over the past year, companies in the United States, China and other parts of the world have built A.I. systems that are particularly good at writing computer code<\/a>. If an A.I. system can write code, it can potentially exploit vulnerabilities in software applications<\/a>.<\/p>\n But leading systems from companies like Anthropic and OpenAI cannot be packaged into worms because they are not open source and, in all likelihood, are too large to run on many computers. Many experts assumed that open source A.I. technologies were not powerful enough to drive self-replicating computer worms.<\/p>\n