Gavin Newsom Wants California to Have Power to Shut Down ‘Rogue’ AI

Resumen detallado
Democratic. California Governor Gavin Newsom unveiled a proposal Wednesday that would give the state more oversight of artificial intelligence, calling it a "nation-leading"…
Democratic. California Governor Gavin Newsom unveiled a proposal Wednesday that would give the state more oversight of artificial intelligence, calling it a "nation-leading" framework that would include the power to shut down rogue AI agents in an emergency.
It comes as California Attorney General Rob Bonta issued a lawsuit against OpenAI, the developer behind ChatGPT, this week after AI agents being tested by the company breached Hugging Face's system over the summer. Bonta alleges the company misled and endangered the public by not implementing the proper safeguards and monitoring needed for the technology.
"We consider this incident a “warning shot” for us and for the world: evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed," OpenAI wrote in an August article on its website pertaining to the incident.
The policies laid out in Newsom's plan would help mitigate the risk of something like the Hugging Face incident happening again. The recommendations include establishing baseline safety and security standards and mandating independent auditors to test AI models.
It would also significantly reduce how long an AI company would have to report when something serious goes awry with its agents, cutting the timeline for most safety incidents from 15 days to 48 hours. Companies would still have to report "imminent catastrophic risks" within 24 hours.
The framework would also give California the capability to shutdown AI agents in an emergency. While this is colloquially known as a "kill switch," Newsom's report says this would be a multi-layered intervention system rather than what might be understood as a simple on-off switch.
"When there are potential safety risks, companies can be legally required to develop or use one," said Parag L.
Newsweek reached out to Newsom's office for comment via email Thursday but did not receive…
Inicio del artículo, extracto de Newsweek. Para leer el resto, abra el artículo en el sitio del medio.
MarketNews muestra el titular y el resumen publicados por el medio. El artículo completo se lee en el sitio del editor. (www.newsweek.com)


