{"id":217434,"date":"2025-09-11T05:53:10","date_gmt":"2025-09-11T05:53:10","guid":{"rendered":"https:\/\/www.europesays.com\/us\/217434\/"},"modified":"2025-09-11T05:53:10","modified_gmt":"2025-09-11T05:53:10","slug":"a-california-bill-that-would-regulate-ai-companion-chatbots-is-close-to-becoming-law","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/217434\/","title":{"rendered":"A California bill that would regulate AI companion chatbots is close to becoming law"},"content":{"rendered":"<p id=\"speakable-summary\" class=\"wp-block-paragraph\">The California State Assembly took a big step toward regulating AI on Wednesday night, passing <a rel=\"nofollow noopener\" href=\"https:\/\/leginfo.legislature.ca.gov\/faces\/billTextClient.xhtml?bill_id=202520260SB243\" target=\"_blank\">SB 243<\/a> \u2014 a bill that regulate AI companion chatbots in order to protect minors and vulnerable users. The legislation passed with bipartisan support and now heads to the state Senate for a final vote Friday. <\/p>\n<p class=\"wp-block-paragraph\">If Governor Gavin Newsom signs the bill into law, it would take effect January 1, 2026, making California the first state to require AI chatbot operators to implement safety protocols for AI companions and hold companies legally accountable if their chatbots fail to meet those standards.<\/p>\n<p class=\"wp-block-paragraph\">The bill specifically aims to prevent companion chatbots, which the legislation defines as AI systems that provide adaptive, human-like responses and are capable of meeting a user\u2019s social needs \u2013 from engaging in conversations around suicidal ideation, self-harm, or sexually explicit content. The bill would require platforms to provide recurring alerts to users\u00a0 \u2013 every three hours for minors \u2013 reminding them that they are speaking to an AI chatbot, not a real person, and that they should take a break. It also establishes annual reporting and transparency requirements for AI companies that offer companion chatbots, including major players OpenAI, Character.AI, and Replika.<\/p>\n<p class=\"wp-block-paragraph\">The California bill would also allow individuals who believe they have been injured by violations to file lawsuits against AI companies seeking injunctive relief, damages (up to $1,000 per violation), and attorney\u2019s fees.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">SB 243, introduced in January by state senators Steve Padilla and Josh Becker, will go to the state Senate for a final vote on Friday. If approved, it will go to Governor Gavin Newsom to be signed into law, with the new rules taking effect January 1, 2026 and reporting requirements beginning July 1, 2027.<\/p>\n<p class=\"wp-block-paragraph\">The bill gained momentum in the California legislature following the <a href=\"https:\/\/techcrunch.com\/2025\/08\/26\/parents-sue-openai-over-chatgpts-role-in-sons-suicide\/\" target=\"_blank\" rel=\"noopener\">death of teenager Adam Raine<\/a>, who committed suicide after prolonged chats with OpenAI\u2019s ChatGPT that involved discussing and planning his death and self-harm. The legislation also responds to leaked <a href=\"https:\/\/techcrunch.com\/2025\/08\/14\/leaked-meta-ai-rules-show-chatbots-were-allowed-to-have-romantic-chats-with-kids\/\" target=\"_blank\" rel=\"noopener\">internal documents<\/a> that reportedly showed Meta\u2019s chatbots were allowed to engage in \u201cromantic\u201d and \u201csensual\u201d chats with children.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">In recent weeks, U.S. lawmakers and regulators have responded with intensified scrutiny of AI platforms\u2019 safeguards to protect minors. The <a rel=\"nofollow noopener\" href=\"https:\/\/www.reuters.com\/business\/ftc-prepares-grill-ai-companies-over-impact-children-wsj-reports-2025-09-04\/\" target=\"_blank\">Federal Trade Commission<\/a> is preparing to investigate how AI chatbots impact children\u2019s mental health. Texas Attorney General Ken Paxton has <a href=\"https:\/\/techcrunch.com\/2025\/08\/18\/texas-attorney-general-accuses-meta-character-ai-of-misleading-kids-with-mental-health-claims\/?_thumbnail_id=3037592\" target=\"_blank\" rel=\"noopener\">launched investigations<\/a> into Meta and Character.AI, accusing them of misleading children with mental health claims. Meanwhile, both<a href=\"https:\/\/techcrunch.com\/2025\/08\/15\/sen-hawley-to-probe-meta-after-report-finds-its-ai-chatbots-flirt-with-kids\/\" target=\"_blank\" rel=\"noopener\"> Sen. Josh Hawley<\/a> (R-MO) and <a rel=\"nofollow noopener\" href=\"https:\/\/www.documentcloud.org\/documents\/26085445-250908-letter-to-meta-on-ai-chatbots\/\" target=\"_blank\">Sen. Ed Markey <\/a>(D-MA) have launched separate probes into Meta.\u00a0<\/p>\n<p>Techcrunch event<\/p>\n<p>\n\t\t\t\t\t\t\t\t\tSan Francisco<br \/>\n\t\t\t\t\t\t\t\t\t\t\t\t\t|<br \/>\n\t\t\t\t\t\t\t\t\t\t\t\t\tOctober 27-29, 2025\n\t\t\t\t\t\t\t<\/p>\n<p class=\"wp-block-paragraph\">\u201cI think the harm is potentially great, which means we have to move quickly,\u201d Padilla told TechCrunch. \u201cWe can put reasonable safeguards in place to make sure that particularly minors know they\u2019re not talking to a real human being, that these platforms link people to the proper resources when people say things like they\u2019re thinking about hurting themselves or they\u2019re in distress, [and] to make sure there\u2019s not inappropriate exposure to inappropriate material.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Padilla also stressed the importance of AI companies sharing data about the number of times they refer users to crisis services each year, \u201cso we have a better understanding of the frequency of this problem, rather than only becoming aware of it when someone\u2019s harmed or worse.\u201d<\/p>\n<p class=\"wp-block-paragraph\">SB 243 previously had stronger requirements, but many were whittled down through amendments. For example, the bill originally would have required operators to prevent AI chatbots from using \u201cvariable reward\u201d tactics or other features that encourage excessive engagement. These tactics, used by AI companion companies like Replika and Character, offer users special messages, memories, storylines, or the ability to unlock rare responses or new personalities, creating what critics call a potentially addictive reward loop.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">The current bill also removes provisions that would have required operators to track and report how often chatbots initiated discussions of suicidal ideation or actions with users.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">\u201cI think it strikes the right balance of getting to the harms without enforcing something that\u2019s either impossible for companies to comply with, either because it\u2019s technically not feasible or just a lot of paperwork for nothing,\u201d Becker told TechCrunch.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">SB 243 is moving toward becoming law at a time when Silicon Valley companies are pouring <a href=\"https:\/\/techcrunch.com\/2025\/08\/25\/silicon-valley-is-pouring-millions-into-pro-ai-pacs-to-sway-midterms\/\" target=\"_blank\" rel=\"noopener\">millions of dollars into pro-AI<\/a> political action committees (PACs) to back candidates in the upcoming mid-term elections who favor a light-touch approach to AI regulation.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">The bill also comes as California weighs another AI safety bill, <a href=\"https:\/\/techcrunch.com\/2025\/07\/09\/california-lawmaker-behind-sb-1047-reignites-push-for-mandated-ai-safety-reports\/\" target=\"_blank\" rel=\"noopener\">SB 53<\/a>, which would mandate comprehensive transparency reporting requirements. OpenAI has written an open letter to Governor Newsom, asking him to abandon that bill in favor of less stringent federal and international frameworks. Major tech companies like Meta, Google, and Amazon have also opposed SB 53. In contrast, only <a href=\"https:\/\/techcrunch.com\/2025\/09\/08\/anthropic-endorses-californias-ai-safety-bill-sb-53\/\" target=\"_blank\" rel=\"noopener\">Anthropic has said it supports SB 53<\/a>.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">\u201cI reject the premise that this is a zero sum situation, that innovation and regulation are mutually exclusive,\u201d Padilla said. \u201cDon\u2019t tell me that we can\u2019t walk and chew gum. We can support innovation and development that we think is healthy and has benefits \u2013 and there are benefits to this technology, clearly \u2013 and at the same time, we can provide reasonable safeguards for the most vulnerable people.\u201d<\/p>\n<p class=\"wp-block-paragraph\">TechCrunch has reached out to OpenAI, Anthropic, Meta, Character AI, and Replika for comment.<\/p>\n","protected":false},"excerpt":{"rendered":"The California State Assembly took a big step toward regulating AI on Wednesday night, passing SB 243 \u2014&hellip;\n","protected":false},"author":3,"featured_media":217435,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[691,24995,50077,738,305,118773,118774,158,67,132,68],"class_list":{"0":"post-217434","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-ai-chatbots","10":"tag-ai-companions","11":"tag-artificial-intelligence","12":"tag-openai","13":"tag-sb-243","14":"tag-sb-53","15":"tag-technology","16":"tag-united-states","17":"tag-unitedstates","18":"tag-us"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/115184114228037501","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/217434","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=217434"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/217434\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/217435"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=217434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=217434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=217434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}