California Governor Gavin Newsom on Monday signed into law a first-of-its-kind law regulating artificial intelligence (AI) chatbots, defying a push from the White House to leave such technology unchecked.
“We’ve seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won’t stand by while companies continue without necessary limits and accountability,” Newson said after signing the bill into law.
The landmark law requires chatbot operators to implement “critical” safeguards regarding interactions with AI chatbots and provides an avenue for people to file lawsuits if failures to do so lead to tragedies, said California Senator Steve Padilla, a Democrat who sponsored the bill.
Photo: AP
The law comes after revelations of suicides involving teenagers who used chatbots prior to taking their lives.
“The tech industry is incentivized to capture young people’s attention and hold it at the expense of their real-world relationships,” Padilla said prior to the bill being voted on in the state senate.
Padilla referred to teen suicides, including that of the 14-year-old son of Florida mother Megan Garcia.
Megan Garcia’s son, Sewell, had fallen in love with a Game of Thrones-inspired chatbot on Character.AI, a platform that allows users — many of them young people — to interact with beloved characters as friends or lovers.
When Sewell Garcia struggled with suicidal thoughts, the chatbot urged him to “come home.”
Seconds later, Sewell Garcia shot himself with his father’s handgun, according to the lawsuit Megan Garcia filed against Character.AI.
“Today, California has ensured that a companion chatbot will not be able to speak to a child or vulnerable individual about suicide, nor will a chatbot be able to help a person to plan his or her own suicide,” Megan Garcia said of the new law.
“Finally, there is a law that requires companies to protect their users who express suicidal ideations to chatbots,” she said.
National rules aimed at curbing AI risks do not exist in the US, with the White House seeking to block individual states from creating their own.
The California law sets guardrails that include reminding users that chatbots are AI-generated and mandating that people who express thoughts of self-harm or suicide be referred to crisis service providers.
“This law is an important first step in protecting kids and others from the emotional harms that result from AI companion chatbots which have been unleashed on the citizens of California without proper safeguards,” said Jai Jaisimha, cofounder of the Transparency Coalition nonprofit group devoted to the safe development of the technology.
California also ramped up penalties for deepfake porn, allowing victims to seek as much at US$250,000 per infraction from those who aid in the distribution of nonconsensual sexually explicit material.
STEPPING UP: Diminished US polar science presence mean opportunities for the UK and other countries, although China or Russia might also fill that gap, a researcher said The UK’s flagship polar research vessel is to head to Antarctica next week to help advance dozens of climate change-linked science projects, as Western nations spearhead studies there while the US withdraws. The RRS Sir David Attenborough, a state-of-the-art ship named after the renowned British naturalist, would aid research on everything from “hunting underwater tsunamis” to tracking glacier melt and whale populations. Operated by the British Antarctic Survey (BAS), the country’s polar research institute, the 15,000-tonne icebreaker — boasting a helipad, and various laboratories and gadgetry — is pivotal to the UK’s efforts to assess climate change’s impact there. “The saying goes
Police in China detained dozens of pastors of one of its largest underground churches over the weekend, a church spokesperson and relatives said, in the biggest crackdown on Christians since 2018. The detentions, which come amid renewed China-US tensions after Beijing dramatically expanded rare earth export controls last week, drew condemnation from US Secretary of State Marco Rubio, who on Sunday called for the immediate release of the pastors. Pastor Jin Mingri (金明日), founder of Zion Church, an unofficial “house church” not sanctioned by the Chinese government, was detained at his home in the southern city of Beihai on Friday evening, said
TICKING CLOCK: A path to a budget agreement was still possible, the president’s office said, as a debate on reversing an increase of the pension age carries on French President Emmanuel Macron yesterday was racing to find a new prime minister within a two-day deadline after the resignation of outgoing French Prime Minister Sebastien Lecornu tipped the country deeper into political crisis. The presidency late on Wednesday said that Macron would name a new prime minister within 48 hours, indicating that the appointment would come by this evening at the latest. Lecornu told French television in an interview that he expected a new prime minister to be named — rather than early legislative elections or Macron’s resignation — to resolve the crisis. The developments were the latest twists in three tumultuous
FIRST STAGE: Hamas has agreed to release 48 Israeli hostages in exchange for 250 ‘national security prisoners’ as well as 1,700 Gazans, but has resisted calls to disarm Israel plans to destroy what remains of Hamas’ network of tunnels under Gaza, working with US approval after its hostages are freed, it said yesterday. Israeli Minister of Defense Israel Katz said that the operation would be conducted under an “international mechanism” led by the US. “Israel’s great challenge after the hostage release phase will be the destruction of all Hamas terrorist tunnels in Gaza,” Katz said. “I have ordered the army to prepare to carry out this mission,” he added. Hamas operates a network of tunnels under Gaza, allowing its fighters to operate out of sight of Israeli reconnaissance. Some have passed under