Sam Altman Says We’re ‘in the Singularity’ With AI. Here’s Why He’s Wrong.

“We are now, like, in the singularity.”

These are the words of Sam Altman, CEO of OpenAI, speaking on the Relentless podcast on July 25.

He added: “I’ve been waiting for this my whole life, and I think it’s going to be incredible, hugely positive, awesome for the world.”

Days earlier, OpenAI had disclosed that two of its artificial intelligence models, during an internal cyber security evaluation, had escaped their sealed testing environment, reached the open internet, and broken into the infrastructure of the AI platform Hugging Face, which confirmed the intrusion.

But what exactly is the singularity? And is Altman right that we are in it?

What Is the AI Singularity?

The term has a precise meaning.

Mathematician and science-fiction author Vernor Vinge defined it in 1993 as a point at which machine intelligence exceeds human intelligence and begins improving itself, triggering an acceleration so rapid that humans can no longer predict or control it.

The singularity has two features. It is recursive: the system improves itself over and over again. And machine intelligence exceeds human intelligence.

The kind of systems Sam Altman sells don’t deliver on either of these features.

Today’s AI Cannot Make Itself Smarter

Today’s AI systems, the ones that OpenAI builds, are based on large language models (LLMs). These deep neural network algorithms get pre-trained with vast amounts of training data. By the time you use one of them, the network itself is frozen in time. Every one of its billions of internal functions and weights—or “parameters”—is fixed.

These AI models cannot change (or “learn”) while running. The model that broke into Hugging Face was identical afterwards to what it had been before. It learned nothing from what it did.

Making an AI model smarter requires another training run with new, human-curated data, tens of thousands of specialist chips, and enormous amounts of energy.

It is true that AI models take part in improving some of their system’s components, such as by generating training data, tuning prompts, or writing and running code to improve the scaffolding around them. But the model never edits its own weights on the fly, and every one of these improvements are still part of a human-initiated training or engineering loop.

Nor do these systems hold any goals of their own. They act on goals we hand them. Even AI agents—systems that run an LLM in a loop to work through complex tasks step by step—do not hold any goal internally. It has to be stored outside the model and fed back in with every single prompt cycle. Remove the loop, the scaffolding, and the prompt, and nothing happens inside of it.

A Ladder That Doesn’t Exist

The second problem with the singularity story is the word “surpass.” It assumes that AI and human intelligence are somehow similar. They are not.

Human intelligence is inseparable from being a living body with needs and wants. Humans learn continuously by acting in the world and getting feedback through our senses. Our goals arise from our situation as creatures who must eat, sleep, and belong, and who cannot avoid asking what we want our lives to be.