Superintelligence denotes a hypothetical AI system whose general cognitive capability decisively exceeds that of the best human minds across virtually every domain of interest, including scientific creativity, strategic planning, and social skill. The canonical definition comes from Nick Bostrom's 2014 Superintelligence: Paths, Dangers, Strategies, which framed it as the central object of long-term AI risk. The term sits one rung above artificial general intelligence (human-level general capability): AGI matches humans, while superintelligence surpasses them, potentially by a wide margin.
Definitions and distinctions
Bostrom distinguished forms of superintelligence by how they exceed humans: speed (the same reasoning, vastly faster), collective (many coordinated systems outperforming any individual), and quality (qualitatively better reasoning). A distinction important for policy separates superintelligence as a threshold (a system crosses a capability line) from superintelligence as a process (continuous capability growth with no sharp boundary), a distinction that maps onto the fast-takeoff versus slow-takeoff debate.
Routes and the takeoff question
The classic concern is recursive self-improvement: a system capable enough to improve its own design could enter a feedback loop, compressing the transition from human-level to far more capable systems into a short window ("hard takeoff"). Critics, including many working AI researchers, argue that capability gains are likely to be gradual, bottlenecked by compute, data, and physical experimentation ("soft takeoff"), making the threshold framing a category error. The two positions represent a structural disagreement about dynamics rather than a simple factual dispute, and the question remains contested.
A June 2026 Google DeepMind report, From AGI to ASI, supplies a formally grounded characterization and a four-pathway taxonomy for the transition. It grounds AGI and ASI on the Legg-Hutter measure — intelligence as average performance across all computable tasks — with Universal AI (the AIXI agent) as the incomputable endpoint, arguing that a continuum removes the need for sharp thresholds. It sets the ASI bar deliberately high, at "a system that exceeds the performance of large human-expert collectives… on virtually all tasks and domains of human activity" rather than individual experts, because a single ASI "may consist of a collective of millions of instances."
The four pathways it names are scaling compute, models and data; algorithmic paradigm shifts; recursive (self-)improvement; and ASI emerging from large-scale multi-agent collectives — described as "largely independent of each other, and… likely to occur in parallel." The report notes that only the scaling pathway "at least allows for fitting forecasting models on historic data," which bears directly on how much weight forecasts of the transition can carry. Its own conclusion favours the process framing over the threshold one: because acceleration "cannot be ruled out," the "image of a single transformative step change… could be inaccurate," and "more apt might be the prospect of a series of transformative societal changes."
The safety argument built on it
Superintelligence is the load-bearing premise of the existential-risk case: a system far more capable than its overseers, pursuing goals imperfectly aligned with human values, could be impossible to correct or contain (the control and alignment problems). This is the framing advanced by MIRI and signatories of the Statement on AI Risk (Yoshua Bengio, Stuart Russell, Max Tegmark, Jaan Tallinn). The opposing camp holds that current large language models are not on a path to autonomous superintelligence at all and that the framing distracts from present-tense harms.
A distinct, governance-oriented treatment appears in the Superintelligence Strategy position (Source: Superintelligence Strategy (Hendrycks, Schmidt, Wang)), which reframes the race to superintelligence as a national-security problem, proposing deterrence ("Mutual Assured AI Malfunction"), nonproliferation, and competitiveness as the organizing pillars rather than alignment alone.
Commercial appropriation of the term
In 2025–26 "superintelligence" migrated from a safety-community term of art into corporate branding and product strategy. Meta reorganized its AI efforts around a Superintelligence Labs group, with Mark Zuckerberg articulating a vision of "personal superintelligence," superintelligence delivered as an individually empowering consumer tool rather than a centralized automating force (Source: Personal Superintelligence (Zuckerberg)). Microsoft AI chief Mustafa Suleyman advanced a contrasting "humanist superintelligence" framing, described as explicitly bounded, controllable, and subordinate to human interests, positioned against open-ended autonomous-agent visions (Source: Towards Humanist Superintelligence — Mustafa Suleyman (mustafa-suleyman.ai, 2025)).
These framings function as positions rather than technical claims: each appropriates the term to argue for a particular development posture (decentralized empowerment versus bounded control), and each implicitly rejects the hard-takeoff loss-of-control account while keeping the aspirational label.
Relation to policy
How superintelligence is treated, whether as an imminent threshold, a distant abstraction, or a marketing frame, shapes downstream policy positions on compute governance, on lab oversight, and on whether the priority risk is loss of control or concentration of power. The same term now anchors opposite agendas, linking the safety-risk literature to the frontier-lab race.
Relationships
- depends-on: Artificial General Intelligence (AGI) (the prior threshold)
- related: AI Existential Risk, Technological Singularity, AI Power Concentration
- supported-by: Superintelligence Strategy (Hendrycks, Schmidt, Wang), Personal Superintelligence (Zuckerberg), Towards Humanist Superintelligence — Mustafa Suleyman (mustafa-suleyman.ai, 2025)
- related: Machine Intelligence Research Institute (MIRI), Yoshua Bengio, Stuart Russell, Max Tegmark, Jaan Tallinn, Meta AI
Provenance note. Built as the missing concept anchor for several already-ingested sources (Bostrom-lineage, Superintelligence Strategy, the Suleyman and Zuckerberg framings) plus established foundational knowledge;
confidence: medium. Created live by the gap-identifier (2026-06-01). The framing debate is presented as contested, not resolved.