← Volver a la portada
Estados Unidos · Mercados regionales · TechCrunch

OpenAI’s chief scientist has thoughts on how to limit AI development

Publicado por TechCrunch · Estados Unidos hace 1 h
OpenAI’s chief scientist has thoughts on how to limit AI development
TechCrunch

Resumen detallado

To establish a speed limit on AI development, you need to agree on how to measure speed.

A new blog post from OpenAI’s chief scientist Jakub Pachocki discusses potential limits on AI development, with a focus on a measurement called perplexity.

Slowing AI development became a particularly hot topic after a former OpenAI and Anthropic researcher said the companies were “gambling with our lives,” and even Anthropic’s IPO filing suggested that the technology could pose “catastrophic or existential risks to society.”

Anthropic CEO Dario Amodei then published a plan to “pace the frontier,” seemingly endorsed by OpenAI CEO Sam Altman and SpaceX CEO Elon Musk. Among other things, Amodei called for companies to agree to “common safety standards as well as limits on the rate of unchecked AI progress.”

But to establish a speed limit on AI development, you need to agree on how you measure speed. Pachocki’s post — described by Altman as “the most important thing OpenAI has published in a while” — suggests perplexity (not to be confused with the company of the same name) could be that measurement.

In Pachochki’s argument, benchmarks that focus on AI’s “downstream capabilities” have quickly become outdated as the technology advances. But perplexity — which “measures how well a model predicts the next token on average; lower perplexity means better predictions” — has remained “informative.”

Pachochki’s post includes a chart of how the perplexity of OpenAI’s models has fallen since GPT 3.5.

“GPT‑4, at ~0.91, was proficient at utilizing chain-of-thought reasoning productively, which motivated the subsequent targeted elicitation of this capability and the creation of modern reasoning models,” he wrote. “Now, as we have reached losses below 0.8, we have seen the emergence of transformative capabilities in fields like cybersecurity and mathematics.”

So in his view, perplexity could provide the basis for “a shared benchmark for general intelligence,” which AI companies could then use to establish “common limits.” With perplexity serving as a standard measurement for AI progress…

Wh…

Inicio del artículo, extracto de TechCrunch. Para leer el resto, abra el artículo en el sitio del medio.

Leer el artículo completo en TechCrunch Inicie sesión para guardar

MarketNews muestra el titular y el resumen publicados por el medio. El artículo completo se lee en el sitio del editor. (techcrunch.com)

También te puede interesar