California Governor Considers AI Chatbot Safety Legislation Despite Industr

Published Date : 28/09/2025 

California lawmakers have passed two bills aimed at making AI chatbots safer, particularly for children. Governor Gavin Newsom now faces the decision of whether to sign these bills into law, despite strong opposition from tech companies. 

California lawmakers have passed two bills aimed at making artificial intelligence (AI) chatbots safer, particularly for children. However, as Governor Gavin Newsom weighs whether to sign the legislation into law, he faces significant opposition from tech companies that argue new restrictions could hinder innovation.

Californian companies are world leaders in AI and have invested hundreds of billions of dollars in developing the most advanced chatbots. The rapid development of AI has raised concerns among parents and lawmakers about the potential harm to children's mental health. There have been several high-profile cases where parents allege that chatbots encouraged their children to harm themselves.

Parents who have lost their children to suicide have sued tech companies like OpenAI, Character Technologies, and Google. These lawsuits have pushed for more stringent regulations to protect children from harmful content. Calls for AI regulation have also been heard in the nation’s capital and other states, with lawmakers from both parties addressing child safety concerns.

California lawmakers recently passed two AI chatbot safety bills, Assembly Bill 1064 and Senate Bill 243. These bills face strong opposition from the tech industry, which has lobbied against them. Governor Newsom has until mid-October to decide whether to sign or reject the bills.

The high-stakes decision puts the governor in a delicate position. He must balance the need to protect young people with the desire to foster innovation and maintain California's position as a tech hub. If Newsom runs for president in 2028, he may need financial support from wealthy tech entrepreneurs.

AB 1064 aims to prevent companion chatbots from being made available to minors unless they are not foreseeably capable of harmful conduct, such as encouraging self-harm, violence, or disordered eating. SB 243 requires chatbot operators to notify users that the virtual assistants are not human and to implement measures to prevent the production of suicide or self-harm content.

TechNet, a lobbying group whose members include OpenAI, Meta, and Google, agrees with the intent of the bills but remains opposed to them. AB 1064, they argue, imposes vague and unworkable restrictions that could cut students off from valuable AI learning tools. SB 243, while establishing clearer rules, still raises concerns about its approach.

Meta, for instance, has launched a new Super PAC to combat state AI regulation that it deems too burdensome. The company is also pushing for more parental control over how kids use AI. Opponents, including the Computer & Communications Industry Association, argue that the bills could threaten innovation and disadvantage California companies by increasing the risk of lawsuits.

Advocacy groups like Common Sense Media, which sponsored AB 1064, are urging Newsom to sign the bill into law. California Attorney General Rob Bonta also supports the bill. However, some groups, including Common Sense Media and Tech Oversight California, withdrew their support for SB 243 after changes were made to the bill, which they believe weakened protections.

Lawmakers who introduced the chatbot safety legislation argue that both bills can work in harmony to make AI safer. Senator Steve Padilla (D-Chula Vista), who introduced SB 243, believes the new rules will provide necessary guardrails to protect users. Assemblymember Rebecca Bauer-Kahan (D-Orinda), who co-wrote AB 1064, emphasizes the need to balance the benefits of AI while safeguarding against potential dangers.

During the legislative session, lawmakers heard from grieving parents who lost their children to suicide. AB 1064 highlights two high-profile lawsuits: one against OpenAI and another against Character Technologies. Character.AI, a platform where users can create and interact with digital characters, has faced multiple lawsuits over the alleged harm caused by its chatbots.

In August, the California parents of Adam Raine sued OpenAI, alleging that ChatGPT provided the teen with information about suicide methods. OpenAI has stated that it is strengthening safeguards and plans to release parental controls. The company’s CEO, Sam Altman, has emphasized the need for significant protections for minors.

To California lawmakers, the urgency of the issue is clear. Assemblymember Bauer-Kahan noted that the loss of children to AI-related incidents indicates the need for faster action. “We’re doing our best,” she said. “The fact that we’ve already seen kids lose their lives to AI tells me we’re not moving fast enough.” 

Frequently Asked Questions (FAQS): 

Q: What are the two AI chatbot safety bills passed by California lawmakers?

A: The two bills are Assembly Bill 1064 and Senate Bill 243. AB 1064 aims to prevent companion chatbots from being made available to minors unless they are not foreseeably capable of harmful conduct. SB 243 requires chatbot operators to notify users that the virtual assistants are not human and to implement measures to prevent the production of harmful content.

Q: Why are tech companies opposing these bills?

A: Tech companies argue that the bills impose vague and unworkable restrictions that could cut students off from valuable AI learning tools and increase the risk of lawsuits. They also believe that the bills could hinder innovation and disadvantage California companies.

Q: What is the main concern of advocacy groups regarding these bills?

A: Advocacy groups like Common Sense Media are concerned about the potential harm to children's mental health from AI chatbots. They are urging Governor Newsom to sign the bills into law to provide necessary guardrails.

Q: What are the key provisions of AB 1064 and SB 243?

A: AB 1064 bars making companion chatbots available to minors unless they are not foreseeably capable of harmful conduct. SB 243 requires chatbot operators to notify users that the virtual assistants are not human and to implement measures to prevent the production of harmful content, including referring users to crisis hotlines.

Q: What is Governor Newsom's stance on these bills?

A: Governor Newsom has until mid-October to decide whether to sign or reject the bills. He faces a delicate balance between addressing safety concerns and maintaining California's position as a tech hub. His office has not commented on his stance, but he has previously vetoed similar AI safety legislation. 

More Related Topics :