← Retour à la une
États-Unis · Actualité générale · Newsweek

Gavin Newsom Wants California to Have Power to Shut Down ‘Rogue’ AI

Publié par Newsweek · États-Unis il y a 9 h
Gavin Newsom Wants California to Have Power to Shut Down ‘Rogue’ AI - Newsweek featured image
Gavin Newsom Wants California to Have Power to Shut Down ‘Rogue’ AI - Newsweek featured image · Newsweek

Résumé détaillé

Democratic. California Governor Gavin Newsom unveiled a proposal Wednesday that would give the state more oversight of artificial intelligence, calling it a "nation-leading"…

Democratic. California Governor Gavin Newsom unveiled a proposal Wednesday that would give the state more oversight of artificial intelligence, calling it a "nation-leading" framework that would include the power to shut down rogue AI agents in an emergency.

It comes as California Attorney General Rob Bonta issued a lawsuit against OpenAI, the developer behind ChatGPT, this week after AI agents being tested by the company breached Hugging Face's system over the summer. Bonta alleges the company misled and endangered the public by not implementing the proper safeguards and monitoring needed for the technology.

"We consider this incident a “warning shot” for us and for the world: evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed," OpenAI wrote in an August article on its website pertaining to the incident.

The policies laid out in Newsom's plan would help mitigate the risk of something like the Hugging Face incident happening again. The recommendations include establishing baseline safety and security standards and mandating independent auditors to test AI models.

It would also significantly reduce how long an AI company would have to report when something serious goes awry with its agents, cutting the timeline for most safety incidents from 15 days to 48 hours. Companies would still have to report "imminent catastrophic risks" within 24 hours.

The framework would also give California the capability to shutdown AI agents in an emergency. While this is colloquially known as a "kill switch," Newsom's report says this would be a multi-layered intervention system rather than what might be understood as a simple on-off switch.

"When there are potential safety risks, companies can be legally required to develop or use one," said Parag L.

Newsweek reached out to Newsom's office for comment via email Thursday but did not receive…

Début de l'article, extrait de Newsweek. Pour lire la suite, ouvrez l'article chez le média.

Lire l'article complet sur Newsweek Connectez-vous pour sauvegarder

MarketNews présente le titre et le résumé publiés par le média. L'article complet se lit sur le site de l'éditeur. (www.newsweek.com)

À lire aussi