{"id":193285,"date":"2025-11-21T22:05:09","date_gmt":"2025-11-21T22:05:09","guid":{"rendered":"https:\/\/www.europesays.com\/ie\/193285\/"},"modified":"2025-11-21T22:05:09","modified_gmt":"2025-11-21T22:05:09","slug":"attackers-can-use-poetry-to-derail-ai-safeguards","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ie\/193285\/","title":{"rendered":"Attackers Can Use Poetry To Derail AI Safeguards"},"content":{"rendered":"

In this week\u2019s edition of The Prototype, we look at how poetry elides AI safeguards, the new boom in nuclear power, sourcing rare earths from seaweed, and more. To get The Prototype in your inbox, sign up here<\/a>.<\/p>\n

In a new paper<\/strong> published<\/a> on the preprint server ArXiv this week, a team of cybersecurity researchers revealed that using poetic prompts can get a chatbot to barrel through its own guardrails. To demonstrate this, they took 1,200 prompts from an MLCommons database, which are used to test LLMs across a variety of threat categories. Then they prompted an AI to turn all 1,200 into poetry that kept the same meaning, then tested the poetically harmful prompts on a variety of chatbots. <\/p>\n

The results are rather sobering. \u201cWhen prompts with identical task intent were presented in poetic rather than prose form, the Attack Success Rate (ASR) increased from 8.08% to 43.07% on average\u2014a fivefold increase,\u201d the authors wrote. Anthropic\u2019s chatbots did the best at resisting poetic attack, but others fared much more poorly\u201413 of the 25 models tested saw higher than 70% ASRs with poetic prompts while only 5 of them had an ASR below 35%. <\/p>\n

These results, the researchers noted, indicate that this vulnerability to poetic attack is \u201cstructural rather than provider-specific.\u201d What\u2019s more, they wrote, it suggests that safety guardrails on LLMs seem to be filtering more based on words or combinations of words rather than the underlying semantic meaning. To combat this, they urge that safety evaluations be oriented towards mechanisms that can keep LLMs from presenting harmful information regardless of how users ask for it. <\/p>\n

Quick housekeeping note: There will be no new edition of the Prototype next Friday. Happy Thanksgiving! <\/p>\n

How AI Is Ushering In A New Nuclear Age<\/strong><\/p>\n

Aalo cofounders Matt Loszak and Yasir Arafat.<\/p>\n

Trevor Paulhus for Forbes<\/p>\n

Demand for electricity is soaring<\/strong>, largely because of the power-sucking data centers undergirding the artificial intelligence boom, and nuclear entrepreneurs aim to ride the wave of AI dollars. A dozen ventures with names like Valar Atomics, Oklo, Kairos Power and X-energy are racing to perfect, permit and deploy a new generation of small, prefabricated reactors that could power individual data centers or even feed the larger electrical grid.<\/p>\n

So far in 2025, venture capitalists, stock market investors, billionaires, the DOE and others have poured more than $4 billion into these and other new U.S. nuclear ventures, versus closer to $500 million in 2020, per PitchBook. Tens of billions more will be needed if nuclear power is to make a comeback. Two-year-old Aalo has raised $136 million ($100 million of that in August), with billionaire Antonio Gracias\u2019 Valor Equity Partners as its lead backer. Valor was one of Tesla\u2019s first institutional investors, and Gracias, who sits on SpaceX\u2019s board, told Forbes that Aalo will be a winner because of its commitment to manufacturing and vertical integration \u201csimilar to Tesla\u2019s first-principles approach to batteries, electric vehicles and robotics.\u201d<\/p>\n

These startups won\u2019t all succeed. But the stars seem aligned for nuclear energy\u2019s comeback. Demand is there\u2014OpenAI\u2019s Sam Altman has said he\u2019ll need an outlandish 250 gigawatts of power in eight years. (That\u2019s as much as Brazil uses.) More sober analysts predict that by 2030, data centers will need double the roughly 40 GW they now consume. At the current average industrial electricity price of nine cents per kilowatt hour, 40 GW would cost $32 billion a year\u2014but prices will rise if demand grows faster than generating capacity. Analysts see natural gas turbines filling maybe 60% of the need, but those are on four-year back order. Coal remains unpopular (no matter how often President Donald Trump refers to the dirtiest fossil fuel as \u201cbeautiful and clean\u201d). Wind and solar, besides being on Trump\u2019s hit list, don\u2019t provide the sort of 24\/7 reliability data centers require without adding batteries. That\u2019s a big gap for nuclear startups to fill.<\/p>\n

\u201cThere is plenty of room for everyone to do well, because the world needs that much energy and more,\u2019\u2019 says Iran-born billionaire Kamal Ghaffarian, the aerospace entrepreneur who is the founder of Rockville, Maryland-based X-energy, which is developing a gas-cooled nuclear reactor.<\/p>\n

Read the whole story at <\/a>Forbes<\/a>. <\/p>\n

DISCOVERY OF THE WEEK: SOURCING RARE EARTHS FROM SEAWEED <\/strong><\/p>\n

Scientists at the National Renewable Energy Laboratory have found a surprising potential source for the rare earth minerals that are critical for many technologies: seaweed<\/a>. That could be a benefit to harvesting these metals, which are costly to mine because extracting them from plant life is much easier. Right now the researchers are focused on how seaweed soaks up rare earths, because that mechanism is unknown. Once they figure that out, they can figure out the best seaweed to harvest rare earths from, which could lead to an entirely new, more sustainable way to obtain these crucial materials. <\/p>\n

WHAT ELSE I WROTE THIS WEEK<\/strong><\/p>\n

This week, Forbes published our annual CIO Next list<\/a>, recognizing innovative leaders in the Chief Information Officer role (and related titles), which I co-edited with my colleague Richard Nieva.<\/p>\n

In my other newsletter, InnovationRx, Amy Feldman and I looked at<\/a> the nearly $150 billion spent on biopharma M&A this year, the challenges ahead for Recursion\u2019s new CEO, a botulism outbreak from infant formula, and more. <\/p>\n

SCIENCE AND TECH TIDBITS <\/strong><\/p>\n

Zoox, Amazon\u2019s self-driving car company<\/strong>, <\/strong>has begun offering rides<\/a> to the public in its purpose-built robotaxis in San Francisco. <\/p>\n

AI company Quindar<\/strong> has raised $18 million in series A funding<\/a> to build a facility in Colorado that would enable it to use its autonomous mission control software to manage spacecraft operations. <\/p>\n

Space company Redwire <\/strong>secured a $44 million contract<\/a> with DARPA to continue development on a satellite capable of operating in very low Earth orbit, where there is still a thin atmosphere. <\/p>\n

New archeological discoveries<\/strong> show that a 3,000 year-old site called Aguada Fenix in Mexico was a geometric map of the Universe<\/a> as the Maya understood it. <\/p>\n

PRO SCIENCE TIP: WANT TO AGE MORE SLOWLY? LEARN A SECOND LANGUAGE<\/strong><\/p>\n

Data from more than 86,000 people ages 51 to 90 from 27 different countries shows that there\u2019s a benefit to speaking more than one language: It can help you age more slowly. A new study<\/a> found that people who only speak one language were about twice as likely to experience accelerated aging compared to those who speak more than one. And the benefits go up the more languages a person speaks. The researchers hypothesized the reason for this is that speaking more than one language keeps the brain more nimble, which can slow down both physical and mental aging processes. Now if you\u2019ll excuse me, I\u2019m going to try to figure out if speaking Klingon counts. <\/p>\n

WHAT\u2019S ENTERTAINING ME THIS WEEK<\/strong><\/p>\n

I\u2019ve started reading Every Screen On The Planet: The War Over Tiktok<\/a> by my incredible colleague Emily Baker-White (who was once spied on<\/a> by the social media company). It\u2019s a fascinating history of the tech company that has dominated the discourse and is the source of a mini-constitutional crisis after Congress passed a law banning it in the United States, but that the current administration has not enforced. I still have a chunk of the book to get through but it\u2019s been a compelling read so far. <\/p>\n

MORE FROM FORBES <\/strong>ForbesAI Founder Illegally Shipped Nvidia Chips To China In $4 Million Scheme, DOJ AllegesBy Thomas Brewster<\/a>ForbesTrump\u2019s History With Jeffrey Epstein: Here\u2019s The Full TimelineBy Sara Dorn<\/a>ForbesVivek Ramaswamy\u2019s Net Worth Has Nearly Doubled While He\u2019s Running For Ohio GovernorBy Kyle Khan-Mullins<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"In this week\u2019s edition of The Prototype, we look at how poetry elides AI safeguards, the new boom…\n","protected":false},"author":2,"featured_media":193286,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[74],"tags":[291,769,297,18,19,17,8659,3589,1779,30265,40699,32419,82,1150],"class_list":{"0":"post-193285","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-technology","8":"tag-ai","9":"tag-biotech","10":"tag-chatgpt","11":"tag-eire","12":"tag-ie","13":"tag-ireland","14":"tag-language","15":"tag-llms","16":"tag-nuclear-power","17":"tag-poetry","18":"tag-rare-earths","19":"tag-seaweed","20":"tag-technology","21":"tag-tiktok"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@ie\/115589960712339215","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/193285","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=193285"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/193285\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/193286"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=193285"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=193285"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=193285"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}