Godlike AI is coming, whether we pace the frontier or not

Resumen detallado
Vernor Vinge is possibly my favorite science fiction author of all time.[1] The Singularity, which he famously predicted would happen somewhere between 2005 and 2030, features…
Vernor Vinge is possibly my favorite science fiction author of all time.[1] The Singularity, which he famously predicted would happen somewhere between 2005 and 2030, features heavily in most of his stories.
It usually happens the same way: an Intelligence Explosion, of the type envisioned by I.J. Good — the smarter AI gets, the faster it’s able to make itself even smarter, meaning that AI becomes godlike nearly instantaneously once it reaches a certain threshold of capability.
Almost every discussion about AI safety that I hear in San Francisco or read in the tech blogosphere centers around this sort of event.
The discussions are all about whether recursive self-improvement (RSI) is near, and whether we should “pace the frontier” — i.e., deliberately slow down or pause AI progress — to stop RSI from creating an intelligence explosion.
As I’ve listened to these arguments, I’ve grown increasingly skeptical that this is the right discussion we should be having. But before I explain why, let me quickly summarize the debate itself, to give an idea of what the arguments look like.
In fact, I’ve published some pieces of that discussion on this blog. Back in September, Ramez Naam wrote a guest post arguing that an intelligence explosion is not imminent.
In a follow-up post, Ramez did a deeper dive on the topic of agent swarms, arguing that they’re not as effective as many people believe.
Theo Jaffee echoed these arguments, noting that OpenAI’s data shows that AI hasn’t even been able to fully automate smaller research tasks yet:
Luis Garicano and Alex Imas also wrote a post downplaying the likelihood of an intelligence explosion.
Inicio del artículo, extracto de Asia Times. Para leer el resto, abra el artículo en el sitio del medio.
MarketNews muestra el titular y el resumen publicados por el medio. El artículo completo se lee en el sitio del editor. (asiatimes.com)


