{"id":1102370,"date":"2026-10-05T19:01:34","date_gmt":"2026-10-05T19:01:34","guid":{"rendered":"https:\/\/www.europesays.com\/us\/1102370\/"},"modified":"2026-10-05T19:01:34","modified_gmt":"2026-10-05T19:01:34","slug":"anthropic-whistleblower-jacob-coxon-doubles-down-on-ai-warnings-at-nyc-hearing-extremely-reckless","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/1102370\/","title":{"rendered":"Anthropic whistleblower Jacob Coxon doubles down on AI warnings at NYC hearing: &#8216;Extremely reckless&#8217;"},"content":{"rendered":"<p>Jacob Coxon, the <a href=\"https:\/\/nypost.com\/2026\/09\/10\/business\/anthropic-insider-who-quit-over-apocalypse-fears-doubles-down-on-doomsday-stance\/\" rel=\"nofollow noopener\" target=\"_blank\">former Anthropic researcher who sparked industry chaos <\/a>by warning AI could kill all humans, doubled down on the threat of human extinction at a New York City Council hearing Monday.<\/p>\n<p>He appeared at the request of Council Speaker Julie Menin, who <a href=\"https:\/\/nypost.com\/2026\/09\/25\/us-news\/nyc-council-takes-aim-at-ai-companies-with-new-bills-mandating-kill-switches-offering-cash-for-whistleblowers\/\" rel=\"nofollow noopener\" target=\"_blank\">urged AI whistleblowers to testify<\/a> as the city seeks to get more involved in regulation of the industry.<\/p>\n<p>\u201cFrom my experience, the companies are being extremely reckless given the stakes,\u201d Coxon said Monday. \u201cThe companies run on a startup mindset: move fast, break things, fix them later. That works for a photo sharing app. It does not work for building the most powerful technology ever built.\u201d<\/p>\n<p>Anthropic whistleblower Jacob Coxon testifying at a City Council hearing on Oct. 5, 2026. Stephen Yang for NY Post<\/p>\n<p>He added that researchers and workers have already lost the ability to fully control AI systems.<\/p>\n<p>\u201cWe don\u2019t understand its drives or why it does the things it does,\u201d he said. \u201cWe\u2019re approaching the point at which the AI systems will be capable of improving themselves.\u201d<\/p>\n<p>\u201cAt my last job, I was in some sense working to automate myself\u2026I can tell you firsthand that the majority of the code is now written by AI, and people do not check it that carefully anymore.\u201d\u00a0<\/p>\n<p>Ex-Google DeepMind researcher Alex Turner and Daniel Kokotajlo \u2014 a former OpenAI researcher who now runs the AI Futures Project, focused on the societal impact of the emerging tech \u2014 also testified that the fast-advancing tech poses major risks.<\/p>\n<p>\u201cA superintelligent swarm could wrest control of human civilization,\u201d Turner said. \u201cIt would know that we would try to stop it from achieving its priorities, so the swarm would likely wait until it\u2019s too late to shut it off; there would be no going back. I myself would guess AI takeover chances at roughly one in three.\u201d<\/p>\n<p>Former OpenAI researcher Daniel Kokotajlo (left) and Google DeepMind researcher Alex Turner (right) virtually testified at the hearing. Stephen Yang for NY Post<\/p>\n<p>Coxon quit his job as an AI researcher Anthropic last month and warned that AI could kill humans. Stephen Yang for NY Post<\/p>\n<p>Kokotajlo argued that even though tech leaders are now supporting calls for more stringent regulations, they shouldn\u2019t necessarily be trusted with that power.<\/p>\n<p>\u201cEven if they do manage to maintain control, I don\u2019t think we should trust them with that control,\u201d he said. \u201cI think that there\u2019s a very real chance that they could use it to become dictators or oligarchs here in the United States.\u201d<\/p>\n<p><a href=\"https:\/\/nypost.com\/2026\/09\/29\/us-news\/openai-google-anthropic-agree-to-attend-nyc-ai-hearing-after-subpoena-threats\/\" rel=\"nofollow noopener\" target=\"_blank\">Reps for Anthropic, OpenAI, Google and Meta<\/a> were all in the same room as some of the companies\u2019 most outspoken critics. The tech giants did not send their CEOs, but rather policy leads and other executives.<\/p>\n<p>Last month, <a href=\"https:\/\/nypost.com\/2026\/09\/09\/tech\/anthropic-researcher-abruptly-quits-warning-some-developers-believe-ai-could-kill-us-all\/\" rel=\"nofollow noopener\" target=\"_blank\">Coxon quit his job at Anthropic and issued a chilling warning<\/a> that AI is advancing so quickly that it \u201ccould kill us all by the end of the decade,\u201d kicking discussions about safeguards and regulations into high gear.<\/p>\n<p>In an unusual move, the leaders of top AI companies responded by calling for more restrictions on their own product releases \u2013 warning that global cooperation is needed to prevent bots from running out of control.<\/p>\n<p>Anthropic CEO Dario Amodei published a lengthy essay calling on rival companies to jointly slow their development of AI models, fearful of the risks that come with \u201crecursive self-improvement,\u201d or RSI \u2013 when bots grow smart enough to keep evolving independently.<\/p>\n<p>Anthropic CEO Dario Amodei (above) has called for more stringent industry regulations. REUTERS<\/p>\n<p>OpenAI\u2019s Sam Altman, SpaceX founder Elon Musk and <a href=\"https:\/\/nypost.com\/2026\/09\/15\/business\/bill-gates-warns-no-government-in-the-world-is-prepared-for-ai-way-behind\/\" rel=\"nofollow noopener\" target=\"_blank\">Microsoft billionaire Bill Gates<\/a> have also sounded the alarm over the risks of unregulated AI advancement.<\/p>\n<p>President Trump, however, has argued that the bigger risk is allowing China to gain a lead in the AI race by slowing development in the US.\u00a0<\/p>\n<p>The AI whistleblowers pushed back on this argument during their testimonies Monday, saying the more pressing threat is getting these bots under control \u2014 not keeping an edge over foreign adversaries. <\/p>\n<p>\u201cWe have to first solve the immediate pressing threat here domestically, and then try to make sure that China doesn\u2019t get us killed either, to put it sort of bluntly and simply,\u201d Kokotajlo said.<\/p>\n<p>The tech giants reportedly agreed to testify at Monday\u2019s hearing after lawmakers threatened to subpoena them to force them to attend.<\/p>\n<p>Menin claimed Google, OpenAI and Anthropic changed their tune and agreed to show up only after the council sent letters threatening to use its subpoena power.<\/p>\n<p>NYC policymakers and tech execs are debating a package of bills aimed at regulating AI companies in the Big Apple, including by mandating \u201ckill switches\u201d and offering unprecedented cash rewards for whistleblowers.<\/p>\n<p>AI safety advocates have urged global cooperation. Anadolu via Getty Images<\/p>\n<p>Though the industry is typically subject to state and federal regulations, New York City is trying to get more involved in the safeguarding of the new technology as it rapidly expands in the city.<\/p>\n<p>It comes after New York Gov. Kathy Hochul announced last month that the state will start requiring AI companies to register in a government portal starting in November, and forcing them to report critical safety incidents within 72 hours.<\/p>\n<p>The City Council\u2019s proposals include a mandate that companies cannot \u201cmarket, offer for sale, or deploy\u201d AI systems in the five boroughs without vetting the tech with outside experts.<\/p>\n<p>It is also proposing a law that would require so-called \u201ckill switches\u201d for any AI tool being used in the city, which the council defines as a \u201chuman override that can shut down the system.\u201d<\/p>\n<p>Failure to comply with either of the laws would result in a $25,000 fine.<\/p>\n<p>Another potential bill would create a \u201cfirst-in-the-nation\u201d cash reward system for whistleblowers, funded by the fines collected from bad actors.<\/p>\n<p>Officials from NYC Mayor Zohran Mamdani\u2019s administration \u2013 including Samuel Levine, commissioner of the Department of Consumer and Worker Protection, and Sarah Milstein from the tech office \u2013 were also set to testify at the hearing.<\/p>\n","protected":false},"excerpt":{"rendered":"Jacob Coxon, the former Anthropic researcher who sparked industry chaos by warning AI could kill all humans, doubled&hellip;\n","protected":false},"author":3,"featured_media":1102371,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[5122],"tags":[5229,24142,738,64,57493,5248,405,403,5226,5225,5228,5227,305,67,586,132,5230,68,2969],"class_list":["post-1102370","post","type-post","status-publish","format-standard","has-post-thumbnail","category-new-york","tag-america","tag-anthropic","tag-artificial-intelligence","tag-business","tag-hearing","tag-metro","tag-new-york","tag-new-york-city","tag-newyork","tag-newyorkcity","tag-ny","tag-nyc","tag-openai","tag-united-states","tag-united-states-of-america","tag-unitedstates","tag-unitedstatesofamerica","tag-us","tag-usa"],"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/117389851837323209","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/1102370","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=1102370"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/1102370\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/1102371"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=1102370"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=1102370"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=1102370"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}