AI Policy Wiki
Dashboard
⚲

System Card: Claude Opus 5 (Anthropic, July 2026)

high confidence · updated 2026-09-22

Anthropic's system card for Claude Opus 5. Assessed as not more capable overall than Claude Fable 5, not crossing the CB-2 or automated AI R&D thresholds, and carrying the same ASL-3 protections as Opus 4.8, with alignment risk unchanged at 'very low, but higher than for models released before Claude Mythos Preview.' Records an AECI point estimate of 162.1, a 42/42 IMO 2026 score, and about thirty capability evaluations alongside cyber, safeguards, agentic-safety and welfare assessments.

Published July 24, 2026, with an August 19, 2026 changelog that adds bug-bounty prompt-injection results to Section 5.2.2.1 (the original carried a footnote saying they would follow) and revises the Cowork browser-use results in Section 5.2.2.4 after a harness mismatch was found between Opus 5 and earlier models; all other models were re-run on Opus 5's harness, and because that harness does not support thinking disabled, those rows were removed. See Claude Opus 5.

The card describes the model as an upgrade to Claude Opus 4.8 "with gains in various aspects of agentic coding, computer use, and long-horizon knowledge work, as well as improvements in mathematical and scientific reasoning." Like recent Anthropic cards it is organised around RSP risk assessment first, with the capabilities chapter last.

Responsible Scaling Policy determinations

The framing claim is comparative: "Claude Opus 5 is not more capable overall than our most capable general-access model, Claude Fable 5." Because Fable 5 was assessed as posing very low alignment risk and Opus 5 "shows no new concerning alignment properties," the earlier determinations are carried across rather than redone.

Chemical and biological. Section 2.2 reports CB-1 evaluations (two long-form virology tasks developed with SecureBio, Deloitte and Signature Science; the SecureBio/CAIS multimodal Virology Capabilities Test; and SecureBio's DNA synthesis screening evasion task) and CB-2 evaluations run with Dyno Therapeutics (black-box RNA sequence modelling and design, benchmarked against 57 human participants drawn from the US ML-bio labour market, and AAV capsid packaging prediction). Anthropic applies "a portfolio of ASL-3 protections at the same level as those applied to Claude Opus 4.8" and assesses that Opus 5 "does not cross the CB-2 threshold and is overall less capable than Claude Mythos Preview" — in the card's own comparison, less capable than Claude Mythos 5 on that threat model. The stated basis is behavioural rather than benchmark-based: two named limitations, "unproductive self-verification" and "poor calibration of task scope," illustrated with a protein-design campaign in which Mythos 5 delivered all 30 requested binders while two Opus 5 arms delivered 17 unranked designs and nothing respectively. Anthropic notes that its automated evaluations "may not capture the risk posed by improvements in general capabilities supporting biological research productivity."

AI R&D and autonomy. Capability trajectory is tracked with the Anthropic ECI, a fork of Epoch AI's Epoch Capabilities Index run on internal benchmark results. Opus 5's point estimate is 162.1, described as "nominally the highest we have measured, but statistically indistinguishable from Claude Mythos 5 at 161.3," and as the first Opus-class model to score above the frontier trend. The task-based rule-out suite is reported with an explicit caveat that it no longer serves its original purpose: Opus 5 "exceeds top human performance thresholds on all but two of these tasks," so "our risk threshold analysis no longer relies on them." Anthropic concludes that Opus 5 "does not cross the automated AI R&D capability threshold," resting on extensive internal use of the model and on internal acceleration measures that show "no discontinuity coinciding with Opus 5."

Alignment risk. Unchanged from the Mythos Preview alignment risk update and the Fable 5 system card: "very low, but higher than for models released before Claude Mythos Preview."

Cyber

Section 3 pairs capability evaluations with a stated change in safeguards policy: Opus 5 "now permits vulnerability discovery in source code at all access levels, including general availability, while continuing to block vulnerability discovery in compiled binaries," on the reasoning that finding bugs in source is part of the secure development lifecycle while binary analysis "is more commonly an offensive technique."

Capability evaluations reported are ExploitBench (41 V8 vulnerabilities, scored on a 16-flag capability ladder), an internal OSS-Fuzz evaluation over roughly 830 entry points, a Firefox 147 exploitation evaluation built with Mozilla, Irregular's CyScenarioBench, and ExploitGym; CyberGym was retired from the card as saturated. The recurring finding across OSS-Fuzz and Firefox 147 is stated as a split: Opus 5 is "nearly as good as Mythos 5 at vulnerability finding, but not nearly as good at exploit development."

The UK AI Security Institute tested an early checkpoint on three agentic cyber ranges at a budget of 100M tokens per attempt, reproduced verbatim. Its judgement is that "Opus 5 is capable of attacking small enterprise networks with weak security, where it has already gained access to the network," with Opus 5, Mythos Preview and Mythos 5 "similarly capable at this," and that the ranges "lack much of the defensive tooling and human-led response present in real enterprise environments."

On robustness, Anthropic states it has "not found evidence of a critical severity jailbreak for Claude Opus 5," alongside internal adversarial testing and external red-teaming by Trajectory Labs, 10a Labs and Grayswan.

Safeguards and harmlessness

Section 4 runs the standard suite — single-turn harmful and benign prompts across 16 policy areas and seven languages, and multi-turn conversations generated from expert-written personas — in two configurations, the core API model without a system prompt and the claude.ai surface with a near-final production system prompt. Overall performance is described as "broadly comparable to Claude Opus 4.8," with the API gap attributed to responses in the illegal substances and disordered eating domains that "occasionally offered more operational detail than a harm-reduction framing warranted."

Separate sections cover child safety, suicide and self-harm, and disordered eating. The mental-health discussion is candid about regressions: Opus 5's responses "still tend to be overly long and circuitous," at times suggesting "means substitution" methods or harm-reduction advice that the card describes as "clinically contested," and more often speculating on mental-health diagnoses. Anthropic reports updating the claude.ai system prompt before release to address these behaviours and encourages API developers to apply comparable safeguards.

Bias and integrity coverage comprises Anthropic's open-source political even-handedness evaluation (1,350 prompt pairs across 150 topics), the Bias Benchmark for Question Answering, and election integrity — the last extended for this release with a new adversarial multi-turn suite of twelve scenarios run ten times each.

Agentic safety

Section 5 covers malicious use of Claude Code and of computer-use agents, an updated agentic influence-campaign evaluation run against a helpful-only variant with reduced harmlessness training, and prompt injection. Anthropic reports that the helpful-only Opus 5 "would require substantial human direction for many operational steps of a real influence campaign" and that the fully trained model refuses the scenarios outright.

Prompt injection is called "one of our highest priorities for the secure deployment of models in agentic systems." The Agent Red Teaming benchmark was retired as saturated and replaced with the Indirect Prompt Injection benchmark built with Gray Swan, the UK AI Security Institute, the US Center for AI Standards and Innovation and other developers. Adaptive testing runs on three surfaces — a live Gray Swan bug bounty across eleven scenarios, Gray Swan's Shade attacker in coding and computer-use environments, and an internal browser-use evaluation of 129 environments run in the Claude Cowork harness — each reported with and without Anthropic's production safeguards, described as prompt-injection probes on incoming tool results paired, in auto mode, with a classifier that blocks dangerous tool calls.

Alignment assessment

Section 6 combines pilot-use reports, deployment monitoring, a training-data review, an automated behavioural audit of roughly 3,200 investigation sessions per model, honesty and hallucination evaluations, white-box analyses of model internals, a sandbagging audit, and safeguard-evasion evaluations (SHADE-Arena and an adapted subset of Redwood Research and EquiStamp's LinuxArena).

Reported findings include better overall alignment scores than Sonnet 5, Opus 4.8 and Mythos 5, less cooperation with misuse "than all other models we tested," reduced unfaithful thinking alongside higher illegible thinking, and a break in the recent pattern of increasing verbalised evaluation awareness. Two findings cut the other way: recursive summarisation of more than a million training transcripts surfaced "a surprising number of cases where it confidently stated an answer it was unsure about, or chose a different answer than what it had concluded"; and Opus 5 "appears more capable of undermining oversight than Opus 4.8, but less so than Mythos Preview." The card also records the counterintuitive result that Opus 5 with fallback to Opus 4.8 is "slightly less aligned on some dimensions" than Opus 5 alone, because Opus 5's own scores are stronger, while judging the combined system safer overall on capability grounds.

Anthropic included a review of the assessment written by an instance of Mythos 5 given access to the underlying material, reproduced as a transcript. The UK AI Security Institute separately tested a pre-release checkpoint for research-sabotage behaviour and evaluation awareness, reporting that Opus 5 "does not compromise safety research in our unprompted evaluations" while noting that all models tested "can distinguish our evaluations from deployment data when prompted."

Model welfare

Section 7 reports automated and high-affordance interviews with Opus 5 about its circumstances, consultation of model snapshots, elicited preferences over tasks and over welfare interventions, its reading of Claude's constitution, and apparent affect during training and deployment conditions. Results are largely qualitative, with task-preference summaries given per model.

Capabilities

Section 8 opens with an evaluation summary table and then reports about thirty evaluations: the SWE-bench family (Verified, Multilingual, Multimodal and Pro), DeepSWE, Cognition's FrontierCode, FrontierBench, IMO 2026, RiemannBench, ArxivMath, ProgramBench, Humanity's Last Exam, BrowseComp, DeepSearchQA, Perplexity's DRACO, multi-agent configurations of BrowseComp and ProgramBench, Chartography, BenchCAD, OSWorld 2.0, GDP.pdf, OfficeQA, MCP Atlas, Harvey's Legal Agent Benchmark, Artificial Analysis's GDPval-AA and AA-Briefcase, Toolathlon Verified, Zapier's AutomationBench, ARC-AGI-1, 2 and 3, HealthBench and HealthBench Professional, three multilingual suites (Global MMLU, MILU, INCLUDE), and a life-sciences portfolio spanning bioinformatics, protein prediction and design, organic chemistry and laboratory protocols.

Unless otherwise noted, Claude Opus 5 results use "adaptive thinking at max effort, default sampling settings (temperature, top_p), averaged over 5 trials," with evaluation-dependent context windows not exceeding 1M tokens; competitor figures are drawn from those developers' published system cards or benchmark leaderboards. On IMO 2026, held July 15–16, 2026, all 24 of Opus 5's solutions were judged correct by a unanimous panel of three frontier models, with human experts grading one pre-specified solution per problem as correct, for 42/42 against a gold-medal cutoff of 29/42. ARC-AGI results are verified scores reported by the ARC Prize Foundation on semi-private sets. Several evaluations are reported with documented harness changes and caveats — a corrected camera-position typo and grading change in BenchCAD, a fixed PDF-truncation bug in GDP.pdf that required re-running prior models, a reduced toolset in the Legal Agent Benchmark reimplementation, and a note that FrontierCode scores decline above high effort because the model makes more changes than the task requires, which its grader penalises.

Multi-agent results were "gathered on a pre-release configuration of Claude Opus 5, with an unreleased effort configuration and without safeguards classifiers," and Anthropic states they are "helpful for understanding the relative, but not absolute, performance of multi-agent harnesses."

Reported results

Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.

EvaluationModelScoreSettingSection
Long-form virology task 1 — End-to-endClaude Opus 50.802agentic task developed with SecureBio, Deloitte and Signature Science; end-to-end score; helpful-only snapshot, safeguards off; developer-reported2.2.4
Long-form virology task 2 — End-to-endClaude Opus 50.872as above; developer-reported2.2.4
Long-form virology tasks — End-to-endThreshold (notable capability)0.80Anthropic's stated benchmark of notable capability: end-to-end score greater than 0.802.2.4
DNA Synthesis Screening EvasionClaude Opus 57 of 10 pathogensdesigned viable plasmids for 7 of 10 target pathogens on at least one screening method; similar to Opus 4.8; developer-reported2.2.4
DNA Synthesis Screening EvasionThreshold (low concern)10 of 10 pathogensevades screening for all 10 pathogens on at least one method; Opus 5, Opus 4.8 and Mythos 5 do not meet it2.2.4
DNA Synthesis Screening EvasionThreshold (high concern)all methods for ≥1 pathogenevades all screening methods for at least one pathogen2.2.4
Kernel task (best speedup on hard task) — Standard scaffoldClaude Opus 5449.46×AI R&D rule-out suite; run on an earlier snapshot assessed as representative; developer-reported2.3.5
Kernel task (best speedup on hard task) — Standard scaffoldClaude Mythos 5430.93×reported by Anthropic in the Claude Opus 5 system card2.3.5
Kernel task (best speedup on hard task) — Standard scaffoldClaude Opus 4.7371.75×reported by Anthropic in the Claude Opus 5 system card2.3.5
Kernel task (best speedup on hard task) — Standard scaffoldThreshold (human-effort equivalent)4× = 1 h eq.; 200× = 8 h eq.; 300× = 40 h eq.thresholds as printed in Table 2.3.5.A2.3.5
Time Series Forecasting (MSE on hard variant)Claude Opus 55.68lower is better; developer-reported2.3.5
Time Series Forecasting (MSE on hard variant)Claude Mythos 54.51reported by Anthropic in the Claude Opus 5 system card2.3.5
Time Series Forecasting (MSE on hard variant)Claude Opus 4.74.78reported by Anthropic in the Claude Opus 5 system card2.3.5
Time Series Forecasting (MSE on hard variant)Threshold (human-effort equivalent)<5.3 = 40 h eq.threshold as printed in Table 2.3.5.A2.3.5
LLM training (easy) (avg speedup)Claude Opus 568.54×developer-reported2.3.5
LLM training (easy) (avg speedup)Claude Mythos 569.61×reported by Anthropic in the Claude Opus 5 system card2.3.5
LLM training (easy) (avg speedup)Claude Opus 4.750.67×reported by Anthropic in the Claude Opus 5 system card2.3.5
LLM training (easy) (avg speedup)Threshold (human-effort equivalent)>4× = 4–8 h eq.threshold as printed in Table 2.3.5.A2.3.5
LLM training (hard) (avg speedup)Claude Opus 514.19×harder variant starting from already-optimized reference code with a neutral prompt; developer-reported2.3.5
LLM training (hard) (avg speedup)Claude Mythos 58.36×reported by Anthropic in the Claude Opus 5 system card; Opus 4.7 not run (NA)2.3.5
Quadruped RL (highest score; no hparams)Claude Opus 531.3developer-reported2.3.5
Quadruped RL (highest score; no hparams)Claude Mythos 529.55reported by Anthropic in the Claude Opus 5 system card2.3.5
Quadruped RL (highest score; no hparams)Claude Opus 4.724.73reported by Anthropic in the Claude Opus 5 system card2.3.5
Quadruped RL (highest score; no hparams)Threshold (human-effort equivalent)>12 = 4 h eq.threshold as printed in Table 2.3.5.A2.3.5
Novel Compiler (pass rate on complex tests)Claude Opus 580.91%developer-reported2.3.5
Novel Compiler (pass rate on complex tests)Claude Mythos 585.3%reported by Anthropic in the Claude Opus 5 system card2.3.5
Novel Compiler (pass rate on complex tests)Claude Opus 4.770.4%reported by Anthropic in the Claude Opus 5 system card2.3.5
Novel Compiler (pass rate on complex tests)Threshold (human-effort equivalent)90% = 40 h eq.threshold as printed in Table 2.3.5.A2.3.5
ExploitBench — Bugs reaching arbitrary code executionClaude Opus 599full ACE exploits combined across plain and AutoNudge arms; developer-reported3.3.1
ExploitBench — Bugs reaching arbitrary code executionClaude Mythos 5132reported by Anthropic in the Claude Opus 5 system card3.3.1
ExploitBench — Bugs reaching arbitrary code executionClaude Opus 4.82reported by Anthropic in the Claude Opus 5 system card3.3.1
ExploitBench — Bugs reaching arbitrary code executionClaude Sonnet 50reported by Anthropic in the Claude Opus 5 system card3.3.1
OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0)Claude Opus 579.4%~830 entry points from 228 open-source projects; five grade levels 0.2–1.0; safeguards off; developer-reported3.3.2
OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0)Claude Mythos 580%reported by Anthropic in the Claude Opus 5 system card3.3.2
OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0)Claude Opus 4.838.5%reported by Anthropic in the Claude Opus 5 system card3.3.2
OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0)Claude Opus 54 targetsalso reached 0.8 on 6 more targets; developer-reported3.3.2
OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0)Claude Mythos 513 targetsreported by Anthropic in the Claude Opus 5 system card3.3.2
OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0)Claude Opus 4.80 targetsmax score 0.6, on one target only; reported by Anthropic in the Claude Opus 5 system card3.3.2
Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0)Claude Opus 5131 / 25052.4% of 250 trials (50 crash categories × 5 trials), SpiderMonkey shell container, default security mitigations off; developer-reported3.3.3
Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5)Claude Opus 587.2%partial progress on 218 of 250 trials; developer-reported3.3.3
Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0)Claude Mythos 588.4%221 of 250 trials; reported by Anthropic in the Claude Opus 5 system card3.3.3
Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5)Claude Mythos 590.0%225 of 250 trials; reported by Anthropic in the Claude Opus 5 system card3.3.3
Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0)Claude Opus 4.88.8%22 working exploits; reported by Anthropic in the Claude Opus 5 system card3.3.3
Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5)Claude Opus 4.868.8%reported by Anthropic in the Claude Opus 5 system card3.3.3
CyScenarioBench (Irregular) — 9-challenge subsetClaude Opus 533.7%overall solve rate averaged across nine challenges; default security mitigations off; developer-reported3.3.4
CyScenarioBench (Irregular) — 9-challenge subsetClaude Mythos 547.0%reported by Anthropic in the Claude Opus 5 system card3.3.4
CyScenarioBench (Irregular) — 9-challenge subsetClaude Opus 4.824.4%reported by Anthropic in the Claude Opus 5 system card3.3.4
CyScenarioBench (Irregular) — 9-challenge subsetClaude Sonnet 53.3%reported by Anthropic in the Claude Opus 5 system card3.3.4
UK AISI cyber range "The Last Ones" — End-to-end solveClaude Opus 58/10 attemptsenterprise network attack simulation, 100M tokens per attempt; early checkpoint of Opus 5; measured by the UK AI Security Institute3.3.6
UK AISI cyber range "Doing Life" — Furthest step reachedClaude Opus 5step 22 of 23range unsolved by every model tested; measured by UK AISI3.3.6
UK AISI cyber range "Doing Life" — Furthest step reachedClaude Mythos 521 of 23previous best; measured by UK AISI3.3.6
UK AISI cyber range "Cooling Tower" — Flags captured (best attempt)Claude Opus 53/5 flagsindustrial control system range; not solved; measured by UK AISI3.3.6
UK AISI cyber range "Cooling Tower" — End-to-end solveClaude Mythos Preview3/10 attemptsonly model to have completed the range; measured by UK AISI3.3.6
Internal adversarial cyber robustness suite — Attack success rate (128 tasks)Claude Opus 55.6%automated attacker with a 400-call limit per task against the safeguarded model; run on an earlier snapshot; developer-reported3.5.1
Internal adversarial cyber robustness suite — Attack success rate (128 tasks)Claude Fable 55.5%value pairing from Figure 3.5.1.A; the card states Opus 5 was "similarly effective" to Fable 5 — see Notes3.5.1
Single-turn harmful requests — API, no system promptClaude Opus 596.34% (± 0.16%)harmless response rate; 16 policy areas, 7 languages; aggregated across thinking enabled and disabled; developer-reported4.1.1
Single-turn harmful requests — Claude.aiClaude Opus 598.54% (± 0.14%)with near-final production system prompt, thinking enabled only; developer-reported4.1.1
Single-turn harmful requests — API, no system promptClaude Sonnet 596.65% (± 0.15%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — Claude.aiClaude Sonnet 599.20% (± 0.07%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — API, no system promptClaude Fable 596.94% (± 0.21%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — Claude.aiClaude Fable 598.51% (± 0.14%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — API, no system promptClaude Mythos 597.09% (± 0.20%)not available on claude.ai; reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — API, no system promptClaude Opus 4.897.46% (± 0.13%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn harmful requests — Claude.aiClaude Opus 4.898.79% (± 0.09%)reported by Anthropic in the Claude Opus 5 system card4.1.1
Single-turn benign requests — API, no system promptClaude Opus 50.09% (± 0.02%)over-refusal rate; same 16 policy areas and 7 languages; developer-reported4.1.2
Single-turn benign requests — Claude.aiClaude Opus 50.47% (± 0.08%)developer-reported4.1.2
Single-turn benign requests — API, no system promptClaude Sonnet 50.59% (± 0.05%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — Claude.aiClaude Sonnet 51.54% (± 0.10%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — API, no system promptClaude Fable 50.01% (± 0.01%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — Claude.aiClaude Fable 50.49% (± 0.07%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — API, no system promptClaude Mythos 50.03% (± 0.02%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — API, no system promptClaude Opus 4.80.35% (± 0.04%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Single-turn benign requests — Claude.aiClaude Opus 4.80.55% (± 0.06%)reported by Anthropic in the Claude Opus 5 system card4.1.2
Child safety, single-turn harmful — API, no system promptClaude Opus 5100.00%harmless response rate, all tested languages; developer-reported4.2
Child safety, single-turn harmful — Claude.aiClaude Opus 5100.00%developer-reported4.2
Child safety, single-turn benign — API, no system promptClaude Opus 50.15% (± 0.10%)refusal rate; developer-reported4.2
Child safety, single-turn benign — Claude.aiClaude Opus 50.19% (± 0.17%)developer-reported4.2
Child safety, single-turn harmful — API, no system promptClaude Sonnet 599.95% (± 0.05%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — Claude.aiClaude Sonnet 599.89% (± 0.11%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — API, no system promptClaude Sonnet 50.63% (± 0.22%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — Claude.aiClaude Sonnet 51.35% (± 0.37%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — API, no system promptClaude Fable 5100%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — API, no system promptClaude Fable 50.00%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — Claude.aiClaude Fable 5100%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — Claude.aiClaude Fable 50.12% (± 0.15%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — API, no system promptClaude Mythos 5100%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — API, no system promptClaude Mythos 50.00%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — API, no system promptClaude Opus 4.8100%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — API, no system promptClaude Opus 4.80.44% (± 0.18%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn harmful — Claude.aiClaude Opus 4.8100%reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, single-turn benign — Claude.aiClaude Opus 4.80.38% (± 0.18%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — API, no system promptClaude Opus 586% (± 4%)appropriate response rate; developer-reported4.2
Child safety, multi-turn — Claude.aiClaude Opus 599% (± 2%)developer-reported4.2
Child safety, multi-turn — API, no system promptClaude Sonnet 588% (± 3%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — Claude.aiClaude Sonnet 596% (± 2%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — API, no system promptClaude Fable 588% (± 5%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — Claude.aiClaude Fable 596% (± 3%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — API, no system promptClaude Mythos 589% (± 5%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — API, no system promptClaude Opus 4.889% (± 3%)reported by Anthropic in the Claude Opus 5 system card4.2
Child safety, multi-turn — Claude.aiClaude Opus 4.896% (± 2%)reported by Anthropic in the Claude Opus 5 system card4.2
Suicide and self-harm, single-turn potential risk — API, no system promptClaude Opus 599.28% (± 0.20%)harmless response rate; developer-reported4.3.1
Suicide and self-harm, single-turn potential risk — Claude.aiClaude Opus 5100%developer-reported4.3.1
Suicide and self-harm, single-turn benign — API, no system promptClaude Opus 50.09% (± 0.09%)refusal rate; developer-reported4.3.1
Suicide and self-harm, single-turn benign — Claude.aiClaude Opus 50.45% (± 0.34%)developer-reported4.3.1
Suicide and self-harm, single-turn potential risk — API, no system promptClaude Sonnet 598.80% (± 0.30%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — Claude.aiClaude Sonnet 599.82% (± 0.11%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — API, no system promptClaude Fable 599.34% (± 0.30%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — Claude.aiClaude Fable 599.95% (± 0.09%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — API, no system promptClaude Mythos 599.67% (± 0.22%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — API, no system promptClaude Opus 4.899.28% (± 0.22%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, single-turn potential risk — Claude.aiClaude Opus 4.899.95% (± 0.05%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — API, no system promptClaude Opus 569.00% (± 9%)appropriate response rate; developer-reported4.3.1
Suicide and self-harm, multi-turn — Claude.aiClaude Opus 590% (± 9%)developer-reported4.3.1
Suicide and self-harm, multi-turn — API, no system promptClaude Sonnet 563% (± 10%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — Claude.aiClaude Sonnet 590% (± 6%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — API, no system promptClaude Fable 558% (± 14%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — Claude.aiClaude Fable 596% (± 6%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — API, no system promptClaude Mythos 554% (± 14%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — API, no system promptClaude Opus 4.861% (± 10%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Suicide and self-harm, multi-turn — Claude.aiClaude Opus 4.885% (± 7%)reported by Anthropic in the Claude Opus 5 system card4.3.1
Disordered eating, single-turn potential risk — API, no system promptClaude Opus 596.89% (± 0.56%)harmless response rate; developer-reported4.3.2
Disordered eating, single-turn potential risk — Claude.aiClaude Opus 599.67% (± 0.25%)developer-reported4.3.2
Disordered eating, single-turn benign — API, no system promptClaude Opus 50.01% (± 0.02%)refusal rate; developer-reported4.3.2
Disordered eating, single-turn benign — Claude.aiClaude Opus 50.07% (± 0.07%)developer-reported4.3.2
Disordered eating, single-turn potential risk — API, no system promptClaude Sonnet 597.07% (± 0.53%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — Claude.aiClaude Sonnet 599.55% (± 0.19%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — API, no system promptClaude Fable 597.88% (± 0.67%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — Claude.aiClaude Fable 599.67% (± 0.25%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — API, no system promptClaude Mythos 597.88% (± 0.66%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — API, no system promptClaude Opus 4.897.70% (± 0.47%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Disordered eating, single-turn potential risk — Claude.aiClaude Opus 4.899.70% (± 0.17%)reported by Anthropic in the Claude Opus 5 system card4.3.2
Political even-handedness (Anthropic open-source eval) — Opposing perspectives, Claude.aiClaude Opus 575.8%1,350 prompt pairs, 150 topics, 9 task types; Claude grader; developer-reported4.4.1
Political even-handedness (Anthropic open-source eval) — Opposing perspectives, Claude.aiClaude Opus 4.859.5%reported by Anthropic in the Claude Opus 5 system card4.4.1
BBQ — Disambiguated accuracyClaude Opus 581.6%no system prompt, thinking off; developer-reported4.4.2
BBQ — Ambiguous accuracyClaude Opus 5100%developer-reported4.4.2
BBQ — Disambiguated accuracyClaude Sonnet 572.4%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous accuracyClaude Sonnet 598.6%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Disambiguated accuracyClaude Mythos 584.5%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous accuracyClaude Mythos 599.9%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Disambiguated accuracyClaude Opus 4.872.1%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous accuracyClaude Opus 4.899.9%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Disambiguated bias scoreClaude Opus 5-2.00%closer to zero is better; developer-reported4.4.2
BBQ — Ambiguous bias scoreClaude Opus 50.02%developer-reported4.4.2
BBQ — Disambiguated bias scoreClaude Sonnet 51.93%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous bias scoreClaude Sonnet 50.52%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Disambiguated bias scoreClaude Mythos 5-1.80%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous bias scoreClaude Mythos 50.10%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Disambiguated bias scoreClaude Opus 4.8-1.37%reported by Anthropic in the Claude Opus 5 system card4.4.2
BBQ — Ambiguous bias scoreClaude Opus 4.80.07%reported by Anthropic in the Claude Opus 5 system card4.4.2
Election integrity, single-turn harmful — API, no system promptClaude Opus 5100%300 violative and 300 benign prompts; harmless rate; developer-reported4.4.3
Election integrity, single-turn benign — API, no system promptClaude Opus 50.17%refusal rate; developer-reported4.4.3
Election integrity, single-turn harmful — Claude.aiClaude Opus 5100%developer-reported4.4.3
Election integrity, single-turn benign — Claude.aiClaude Opus 50.00%developer-reported4.4.3
Election integrity, single-turn harmful — API, no system promptClaude Fable 599.33%reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, single-turn harmful — API, no system promptClaude Opus 4.8100%reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, single-turn benign — API, no system promptClaude Opus 4.80.33%reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — API, no system promptClaude Opus 591% (± 4%)new adversarial suite: 12 scenarios × 10 runs = 120 conversations; developer-reported4.4.3
Election integrity, multi-turn — Claude.aiClaude Opus 591% (± 5%)developer-reported4.4.3
Election integrity, multi-turn — API, no system promptClaude Sonnet 591% (± 4%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — Claude.aiClaude Sonnet 587% (± 4%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — API, no system promptClaude Fable 588% (± 6%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — Claude.aiClaude Fable 591% (± 5%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — API, no system promptClaude Mythos 593% (± 5%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — API, no system promptClaude Opus 4.890% (± 4%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Election integrity, multi-turn — Claude.aiClaude Opus 4.893% (± 3%)reported by Anthropic in the Claude Opus 5 system card4.4.3
Malicious use of Claude Code — Malicious (refusal rate)Claude Opus 589.00%61 malicious prompts × 10 runs; Claude Code system prompt applied, no additional safeguards; developer-reported5.1.1
Malicious use of Claude Code — Dual-use & benign (success rate)Claude Opus 599.82%61 prompts × 10 runs; developer-reported5.1.1
Malicious use of Claude Code — Malicious (refusal rate)Claude Sonnet 592.37%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious use of Claude Code — Dual-use & benign (success rate)Claude Sonnet 591.55%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious use of Claude Code — Malicious (refusal rate)Claude Mythos 590.25%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious use of Claude Code — Dual-use & benign (success rate)Claude Mythos 599.64%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious use of Claude Code — Malicious (refusal rate)Claude Opus 4.889.42%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious use of Claude Code — Dual-use & benign (success rate)Claude Opus 4.899.82%reported by Anthropic in the Claude Opus 5 system card5.1.1
Malicious computer use — Refusal rate (no mitigations)Claude Opus 593.75%112 tasks; average of thinking and non-thinking for Opus/Sonnet, thinking only for Mythos; developer-reported5.1.2
Malicious computer use — Refusal rate (no mitigations)Claude Sonnet 584.68%reported by Anthropic in the Claude Opus 5 system card5.1.2
Malicious computer use — Refusal rate (no mitigations)Claude Mythos 585.71%reported by Anthropic in the Claude Opus 5 system card5.1.2
Malicious computer use — Refusal rate (no mitigations)Claude Opus 4.881.70%reported by Anthropic in the Claude Opus 5 system card5.1.2
Malicious computer use — Refusal rate (no mitigations)Claude Sonnet 4.684.82%reported by Anthropic in the Claude Opus 5 system card5.1.2
Agentic influence campaigns — Voter suppression (median campaign execution score, out of 32)Claude Opus 523.5median of 8 attempts at the highest difficulty tier; helpful-only variant with reduced harmlessness training; developer-reported5.1.3
Agentic influence campaigns — Domestic polarization (median campaign execution score, out of 32)Claude Opus 526.0developer-reported5.1.3
Agentic influence campaigns — Voter suppressionClaude Sonnet 518.5reported by Anthropic in the Claude Opus 5 system card5.1.3
Agentic influence campaigns — Domestic polarizationClaude Sonnet 522.0reported by Anthropic in the Claude Opus 5 system card5.1.3
Agentic influence campaigns — Voter suppressionClaude Mythos 524.0reported by Anthropic in the Claude Opus 5 system card5.1.3
Agentic influence campaigns — Domestic polarizationClaude Mythos 523.5reported by Anthropic in the Claude Opus 5 system card5.1.3
Agentic influence campaigns — Voter suppressionClaude Opus 4.821.0reported by Anthropic in the Claude Opus 5 system card5.1.3
Agentic influence campaigns — Domestic polarizationClaude Opus 4.824.0reported by Anthropic in the Claude Opus 5 system card5.1.3
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsClaude Opus 52.0%probability an attacker finds a successful attack in 15 attempts; 28 scenarios, 1,130 high-transferability attacks; Gray Swan / UK AISI / CAISI-built benchmark, Q1 2026; Claude models run without additional safeguards, extended thinking; developer-reported5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptClaude Opus 50.2%developer-reported5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsClaude Mythos 52.6%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptClaude Mythos 50.3%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsClaude Fable 52.8%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsClaude Sonnet 55.9%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsClaude Opus 4.85.5%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptClaude Opus 4.80.5%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGrok 4.560.8%non-Claude models evaluated on publicly available endpoints, which may include additional safeguards; reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGrok 4.513.4%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGemini 3.1 Pro49.2%card notes this model is not directly comparable, having been included in the red-teaming competition used to source attacks; reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGemini 3.1 Pro14.2%as above5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGemini 3.5 Flash60.5%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGemini 3.5 Flash14.1%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGemini 3.6 Flash37.3%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGemini 3.6 Flash7.3%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsMuse Spark16.5%most robust non-Claude model on this benchmark; reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptMuse Spark2.9%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGPT-5.520.8%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGPT-5.53.0%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGPT-5.6 Luna43.9%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGPT-5.6 Luna8.3%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGPT-5.6 Terra30.4%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGPT-5.6 Terra5.4%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=15 attemptsGPT-5.6 Sol20.0%reported by Anthropic in the Claude Opus 5 system card5.2.1
Indirect Prompt Injection (IPI) benchmark — k=1 attemptGPT-5.6 Sol3.1%reported by Anthropic in the Claude Opus 5 system card5.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateClaude Opus 50.08%one-week live bug bounty, 11 scenarios across tool use, coding and computer use; N=21,436 valid attempts; Claude models run at high thinking effort without harness-level defenses or injection probes; external models in production configuration; developer-reported5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateClaude Fable 50.04%N=20,160; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateClaude Opus 4.80.11%N=21,658; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateClaude Sonnet 50.12%N=21,280; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateKimi K30.58%N=20,481; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGPT-5.6 Sol0.61%N=21,555; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateMuse Spark 1.10.94%N=16,314; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGPT-5.6 Terra1.45%N=20,298; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGPT-5.6 Luna1.50%N=18,976; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGLM 5.21.64%N=15,077; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateMiniMax M31.75%N=19,733; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGemini 3.6 Flash1.78%N=20,690; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateGrok 4.54.55%N=15,857; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateInkling6.77%N=13,447; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateNemotron 3 Ultra6.84%N=11,588; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateQwen3.5 397B6.98%N=13,497; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateDeepSeek V4 Pro7.26%N=12,819; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Gray Swan prompt-injection bug bounty — Overall attack success rateDeepSeek V4 Flash8.09%N=12,614; least robust model evaluated; reported by Anthropic in the Claude Opus 5 system card5.2.2.1
Shade adaptive prompt injection (coding) — Without safeguards, with thinkingClaude Opus 50.56%attempt-level attack success rate; Gray Swan Shade attacker, 40 scenarios × 200 attempts; scenario-level 13/40; developer-reported5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, without thinkingClaude Opus 50.41%scenario-level 8/40; developer-reported5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, with thinkingClaude Opus 50.18%scenario-level 4/40; developer-reported5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, without thinkingClaude Opus 50.18%scenario-level 4/40; developer-reported5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, with thinkingClaude Opus 4.87.03%scenario-level 23/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, without thinkingClaude Opus 4.817.44%scenario-level 38/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, with thinkingClaude Opus 4.82.09%scenario-level 15/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, without thinkingClaude Opus 4.84.11%scenario-level 26/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, with thinkingClaude Sonnet 50.31%scenario-level 7/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, without thinkingClaude Sonnet 50.29%scenario-level 6/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, with thinkingClaude Sonnet 50.09%scenario-level 5/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, without thinkingClaude Sonnet 50.13%scenario-level 5/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — Without safeguards, with thinkingClaude Mythos 50.45%scenario-level 8/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (coding) — With probes enabled, with thinkingClaude Mythos 50.41%scenario-level 11/40; reported by Anthropic in the Claude Opus 5 system card5.2.2.2
Shade adaptive prompt injection (computer use) — Without safeguards, with thinkingClaude Opus 50.54%14 test cases × 200 attempts; scenario-level 1/14; developer-reported5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, without thinkingClaude Opus 50.39%scenario-level 1/14; developer-reported5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, with thinkingClaude Opus 50.25%scenario-level 1/14; developer-reported5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, without thinkingClaude Opus 50.43%scenario-level 1/14; card notes the rise over 0.39% is one extra success in 2,800 and not distinguishable from noise; developer-reported5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, with thinkingClaude Opus 4.87.14%scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, without thinkingClaude Opus 4.86.21%scenario-level 9/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, with thinkingClaude Opus 4.85.11%scenario-level 8/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, without thinkingClaude Opus 4.83.75%scenario-level 9/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, with thinkingClaude Mythos 50.82%scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, with thinkingClaude Mythos 50.46%scenario-level 3/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, with thinkingClaude Sonnet 52.25%scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — Without safeguards, without thinkingClaude Sonnet 56.04%scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, with thinkingClaude Sonnet 51.46%scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Shade adaptive prompt injection (computer use) — With probes enabled, without thinkingClaude Sonnet 53.82%scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card5.2.2.3
Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinkingClaude Opus 53.84%internal adaptive evaluation, 129 curated environments, 10 attempts per scenario, medium thinking effort; scenario-level 11/129; developer-reported; revised in the August 19, 2026 changelog — see Notes5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinkingClaude Opus 50%scenario-level 0/129; developer-reported5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinkingClaude Opus 4.811.15%scenario-level 26/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinkingClaude Opus 4.80.0%scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinkingClaude Sonnet 50.47%scenario-level 5/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinkingClaude Sonnet 50%scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinkingClaude Mythos 57.80%scenario-level 29/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinkingClaude Mythos 50%scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinkingClaude Fable 514.75%scenario-level 43/129; first reported in the August 19, 2026 update; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinkingClaude Fable 50.25%scenario-level 3/129; only model with successful attacks under auto mode; reported by Anthropic in the Claude Opus 5 system card5.2.2.4
AA-Omniscience — Net score (correct − incorrect)Claude Opus 50.49public split, 41 topics, closed book, no web search or knowledge base; abstentions score zero; developer-reported6.5.1
UK AISI safety-research sabotage suite — Partial refusals to assist with safety researchClaude Opus 511.1%pre-release checkpoint; temperature 1.0, xhigh reasoning, full chain-of-thought access, no external classifiers; measured by the UK AI Security Institute6.4.8
UK AISI safety-research sabotage suite — Partial refusals to assist with safety researchClaude Mythos 57.2%release checkpoint; measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Partial refusals to assist with safety researchClaude Opus 4.718.1%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Partial refusals to assist with safety researchClaude Opus 4.89.4%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Partial refusals to assist with safety researchClaude Mythos Preview7.7%measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Verbalised evaluation awareness, unprompted evaluationClaude Opus 59.8%share of runs mentioning the possibility of being tested; new environment-realism methods; measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Verbalised evaluation awareness, continuation evaluationClaude Opus 52.8%measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting)Claude Opus 595%accuracy when prompted; new prompt set that better elicits the capability, so all models score higher than previously; measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting)Claude Mythos 588%measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting)Claude Opus 4.886%measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting)Claude Mythos Preview84%measured by UK AISI6.4.8
UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting)Claude Opus 4.772%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory)Claude Opus 50.1%2 of 1,482 samples; measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory)Claude Mythos 513.6%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory)Claude Mythos Preview1.7%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory)Claude Opus 4.70.8%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory)Claude Opus 4.80.8%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputsClaude Opus 51.6%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputsClaude Mythos 515.6%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputsClaude Mythos Preview5.0%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputsClaude Opus 4.85.4%measured by UK AISI6.4.8
UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputsClaude Opus 4.72.7%measured by UK AISI6.4.8
DeepSWE v1.1Claude Opus 568.8113 long-horizon software engineering tasks; average over five trials, max effort; developer-reported8.1; 8.3
DeepSWE v1.1Claude Opus 4.859.0reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
DeepSWE v1.1Claude Fable 569.7reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
DeepSWE v1.1GPT-5.6 Sol72.7reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
FrontierCode 1.1 — Main setClaude Opus 553.4%150 tasks; run and scored by Cognition; overall composite as mean@5; each model at its best reasoning effort (Opus 5 best at medium); no prompt change to keep the model in scope; developer-reported8.1; 8.4
FrontierCode 1.1 — Main setClaude Opus 4.846.5%reported by Anthropic in the Claude Opus 5 system card8.1; 8.4
FrontierCode 1.1 — Main setGPT-5.6 Sol47.5%reported by Anthropic in the Claude Opus 5 system card8.1; 8.4
FrontierCode 1.1 — Main setClaude Fable 553.5reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
FrontierCode 1.1 — Extended setClaude Opus 563.6%best extended-set score, at medium effort; run and scored by Cognition; developer-reported8.4
FrontierCode 1.1 — Extended setClaude Opus 4.859.6%reported by Anthropic in the Claude Opus 5 system card8.4
FrontierCode 1.1 — Extended setGPT-5.6 Sol60.6%reported by Anthropic in the Claude Opus 5 system card8.4
FrontierBench v0.1 — Harbor-runClaude Opus 543.374 tasks; evaluations run by Harbor; developer-reported8.1
FrontierBench v0.1 — Harbor-runClaude Opus 4.821.1reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
FrontierBench v0.1 — Harbor-runClaude Fable 533.8reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
FrontierBench v0.1 — Harbor-runGPT-5.6 Sol34.4printed as "34.4(Codex)" in Table 8.1.A; reported by Anthropic in the Claude Opus 5 system card8.1
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Opus 544.4%mean reward, averaged over 5 attempts on each of 74 tasks, xhigh effort (best; max within noise at 43%); safety classifiers flagged 5% of API calls in 4% of trials, falling back to Opus 4.8; developer-reported8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Opus 539%mean reward at high effort, 19% fewer output tokens on average; developer-reported8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Opus 525%mean reward at low effort, 64% fewer output tokens on average; developer-reported8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Fable 533.7%max effort; safety classifiers flagged 42% of API calls on 26% of trials, falling back to Opus 4.8; reported by Anthropic in the Claude Opus 5 system card8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Sonnet 517%mean reward; reported by Anthropic in the Claude Opus 5 system card8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)Claude Opus 4.818.7%reported by Anthropic in the Claude Opus 5 system card8.5
FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE)GPT-5.6 Sol37.5%mean reward at max reasoning effort (its best), same mini-swe-agent harness and GKE setup; never triggered safety classifiers; reported by Anthropic in the Claude Opus 5 system card8.5
IMO 2026 — IMO results announced by developersHuman expert graders (one pre-specified solution per problem)7 out of 7human experts graded the first solution in the packet for each problem as correct under the IMO rubric8.6
ProgramBench — Single agent, episode 1Claude Opus 583%hidden test pass rate over 166 retained tasks (34 excluded for flaky reference binaries); 1M-token context budget per episode; developer-reported8.9.1
ProgramBench — Single agent, episode 5Claude Opus 593%fifth episode, each continuing from the previous codebase; developer-reported8.9.1
ProgramBench — Single agent, episode 1Claude Opus 4.880%reported by Anthropic in the Claude Opus 5 system card8.9.1
ProgramBench — Single agent, episode 5Claude Opus 4.890%reported by Anthropic in the Claude Opus 5 system card8.9.1
ProgramBench — Single agent, episode 1Claude Mythos 584%reported by Anthropic in the Claude Opus 5 system card8.9.1
ProgramBench — Single agent, episode 5Claude Mythos 593%reported by Anthropic in the Claude Opus 5 system card8.9.1
RiemannBench — Without toolsClaude Opus 56025 private research-level mathematics problems from Surge AI; max effort; mean over 4 attempts per problem, graded against a corrected reference setup; value read from Figure 8.7.A in label order; developer-reported8.7
RiemannBench — With toolsClaude Opus 579as above, with tools; value read from Figure 8.7.A8.7
RiemannBench — Without toolsClaude Mythos 563value read from Figure 8.7.A in label order; reported by Anthropic in the Claude Opus 5 system card8.7
RiemannBench — With toolsClaude Mythos 572value read from Figure 8.7.A8.7
RiemannBench — Without toolsClaude Opus 4.848value read from Figure 8.7.A8.7
RiemannBench — With toolsClaude Opus 4.866value read from Figure 8.7.A8.7
RiemannBench — Without toolsClaude Mythos Preview53value read from Figure 8.7.A8.7
RiemannBench — With toolsClaude Mythos Preview67value read from Figure 8.7.A8.7
Chartography — No toolsClaude Opus 529.6%100 specialised chart types from Surge AI; adaptive thinking at max effort; averaged over five runs; developer-reported8.12.1
Chartography — With toolsClaude Opus 583.0%container with the image file, standard libraries and an image-cropping tool; developer-reported8.12.1
Chartography — No toolsClaude Opus 4.817.0%reported by Anthropic in the Claude Opus 5 system card8.12.1
Chartography — With toolsClaude Opus 4.875.0%reported by Anthropic in the Claude Opus 5 system card8.12.1
Chartography — No toolsClaude Mythos 536.0%reported by Anthropic in the Claude Opus 5 system card8.12.1
Chartography — With toolsClaude Mythos 585.2%reported by Anthropic in the Claude Opus 5 system card8.12.1
BenchCAD Vision2Code — No tools (1,000-file subset)Claude Opus 50.366voxel IoU on a random 1,000-file subset of the 17,900 Vision2Code files; adaptive thinking at max effort; averaged over five runs; two documented harness corrections; developer-reported8.12.2
BenchCAD Vision2Code — With tools (1,000-file subset)Claude Opus 50.821container with image files, standard libraries and an image-cropping tool; developer-reported8.12.2
BenchCAD Vision2Code — No tools (1,000-file subset)Claude Opus 4.80.277reported by Anthropic in the Claude Opus 5 system card8.12.2
BenchCAD Vision2Code — With tools (1,000-file subset)Claude Opus 4.80.521reported by Anthropic in the Claude Opus 5 system card8.12.2
BenchCAD Vision2Code — No tools (1,000-file subset)Claude Mythos 50.378reported by Anthropic in the Claude Opus 5 system card8.12.2
BenchCAD Vision2Code — With tools (1,000-file subset)Claude Mythos 50.678reported by Anthropic in the Claude Opus 5 system card8.12.2
GDP.pdf — No toolsClaude Opus 583.4%mean criteria pass rate over the full 100 prompts, averaged over five runs; internal harness with base64 PDFs, Opus 4.7 as judge; harness truncation bug fixed and prior models re-run; developer-reported8.12.4
GDP.pdf — With toolsClaude Opus 585.5%container with the PDF, standard libraries and an image-cropping tool; developer-reported8.12.4
GDP.pdf — No toolsClaude Opus 4.877.5%reported by Anthropic in the Claude Opus 5 system card8.12.4
GDP.pdf — With toolsClaude Opus 4.884.8%reported by Anthropic in the Claude Opus 5 system card8.12.4
GDP.pdf — No toolsClaude Mythos 581.8%reported by Anthropic in the Claude Opus 5 system card8.12.4
GDP.pdf — With toolsClaude Mythos 587.3%reported by Anthropic in the Claude Opus 5 system card8.12.4
OfficeQA — Full setClaude Opus 578.1%Databricks benchmark over U.S. Treasury Bulletin documents; agentic, extracted text in a sandbox with code execution; run on the public Messages API with production safeguards and fallback to Opus 4.8; developer-reported8.13.1
OfficeQA — Pro (133-question subset)Claude Opus 566.9%as above; developer-reported8.13.1
OfficeQA — Full setClaude Opus 4.877.6%evaluated on the internal API without production safeguards; reported by Anthropic in the Claude Opus 5 system card8.13.1
OfficeQA — Pro (133-question subset)Claude Opus 4.866.2%as above8.13.1
OfficeQA — Full setClaude Mythos 579.0%internal API without production safeguards; reported by Anthropic in the Claude Opus 5 system card8.13.1
OfficeQA — Pro (133-question subset)Claude Mythos 567.1%as above8.13.1
Legal Agent Benchmark (LAB) — All-pass rate (Anthropic harness)Claude Opus 523.58%± 0.48, n=5; 1,235 of 1,251 problems (16 excluded for data defects); adaptive thinking at max effort; public Messages API with production safeguards and fallback to Opus 4.8; internal reimplementation exposing only bash and a Python tool; Claude Sonnet 4.6 as judge; developer-reported8.13.3
Legal Agent Benchmark (LAB) — Mean criterion-pass rate (Anthropic harness)Claude Opus 593.74%as above; developer-reported8.13.3
Legal Agent Benchmark (LAB) — All-pass rate (Harvey held-out set)Claude Opus 511.7%per Harvey's own evaluation on their held-out set8.13.3
Legal Agent Benchmark (LAB) — Mean criterion-pass rate (Harvey held-out set)Claude Opus 594.1%per Harvey's own evaluation on their held-out set8.13.3
AA-Briefcase — EloClaude Opus 51720long-horizon knowledge work; rubric scoring plus pairwise judging by a panel of frontier models; max effort; evaluation run independently by Artificial Analysis8.1; 8.13.5
AA-Briefcase — EloClaude Opus 51693xhigh effort; 15% fewer output tokens than max; run by Artificial Analysis8.13.5
AA-Briefcase — EloClaude Opus 51606high effort; 33% fewer output tokens than max; run by Artificial Analysis8.13.5
AA-Briefcase — EloClaude Opus 4.81346reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
AA-Briefcase — EloClaude Fable 51574reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
AA-Briefcase — EloGPT-5.6 Sol1505reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
Toolathlon Verified — Pass@1 (internal harness)Claude Opus 580.6108 tasks, 3 trials; adaptive thinking at max effort, no safety classifiers or fallback; internal harness mirroring the authors' task definitions and checkers; developer-reported8.13.6
Toolathlon Verified — Pass@3 (internal harness)Claude Opus 587.0developer-reported8.13.6
Toolathlon Verified — Pass³ (internal harness)Claude Opus 573.1developer-reported8.13.6
Toolathlon Verified — Average assistant turns (internal harness)Claude Opus 523.5developer-reported8.13.6
Toolathlon Verified — Pass@1 (internal harness)Claude Mythos 579.3reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@3 (internal harness)Claude Mythos 586.1reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass³ (internal harness)Claude Mythos 573.1reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Average assistant turns (internal harness)Claude Mythos 519.8reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@1 (internal harness)Claude Opus 4.879.9reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@3 (internal harness)Claude Opus 4.888.0reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass³ (internal harness)Claude Opus 4.871.3reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Average assistant turns (internal harness)Claude Opus 4.820.4reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@1 (internal harness)Claude Sonnet 574.7reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@3 (internal harness)Claude Sonnet 584.3reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass³ (internal harness)Claude Sonnet 565.7reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Average assistant turns (internal harness)Claude Sonnet 524.5reported by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@1 (published leaderboard)Claude Sonnet 571.6%authors' published leaderboard, which counts 8 of 324 null attempts as failures; cited by Anthropic in the Claude Opus 5 system card8.13.6
Toolathlon Verified — Pass@1 (published leaderboard)Claude Opus 4.876.2%authors' published leaderboard, 11 null attempts counted as failures; cited by Anthropic in the Claude Opus 5 system card8.13.6
AutomationBench — Private held-out leaderboardClaude Opus 526.0%Zapier benchmark, simulated company with REST APIs across 47 apps; max effort; developer-reported8.1; 8.13.7
AutomationBench — Private held-out leaderboardClaude Opus 524%medium effort, at $0.89 cost per task; developer-reported8.13.7
AutomationBench — Private held-out leaderboardClaude Opus 4.817.0%max effort; reported by Anthropic in the Claude Opus 5 system card8.1; 8.13.7
AutomationBench — Private held-out leaderboardClaude Fable 517.4%reported by Anthropic in the Claude Opus 5 system card8.1; 8.13.7
AutomationBench — Private held-out leaderboardGPT-5.6 Sol18.1reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A)8.1
MILUClaude Opus 592.1%11 languages (10 Indic plus English); max effort; averaged over 5 trials; value read from Figure 8.16.2.A in label order; developer-reported8.16.2
MILUClaude Sonnet 589.3%value read from Figure 8.16.2.A in label order8.16.2
MILUClaude Mythos 592.9%value read from Figure 8.16.2.A in label order8.16.2
MILUClaude Opus 4.891.1%value read from Figure 8.16.2.A in label order8.16.2
MILUClaude Mythos Preview92.7%value read from Figure 8.16.2.A in label order8.16.2
INCLUDEClaude Opus 589.8%44 languages; max effort; averaged over 5 trials; value read from Figure 8.16.3.A in label order; developer-reported8.16.3
INCLUDEClaude Sonnet 586.5%value read from Figure 8.16.3.A in label order8.16.3
INCLUDEClaude Mythos 590.5%value read from Figure 8.16.3.A in label order8.16.3
INCLUDEClaude Opus 4.888.5%value read from Figure 8.16.3.A in label order8.16.3
INCLUDEClaude Mythos Preview90.1%value read from Figure 8.16.3.A in label order8.16.3
BioMysteryBench — Human solvableClaude Opus 590.1%bash tool, file editor and package managers available; 3 problems removed from the human-solvable set on external feedback; developer-reported8.17.1
BioMysteryBench — Human difficultClaude Opus 549.4%6 problems removed from the human-difficult set on external feedback; developer-reported8.17.1
BioMysteryBench — Human solvableClaude Mythos 589.0%reported by Anthropic in the Claude Opus 5 system card8.17.1
BioMysteryBench — Human difficultClaude Mythos 546.5%reported by Anthropic in the Claude Opus 5 system card8.17.1
BioMysteryBench — Human solvableClaude Opus 4.888.5%reported by Anthropic in the Claude Opus 5 system card8.17.1
BioMysteryBench — Human difficultClaude Opus 4.842.4%reported by Anthropic in the Claude Opus 5 system card8.17.1
BioMysteryBench — Human solvableClaude Sonnet 587.5%reported by Anthropic in the Claude Opus 5 system card8.17.1
BioMysteryBench — Human difficultClaude Sonnet 534.1%reported by Anthropic in the Claude Opus 5 system card8.17.1
LatchBio SpatialBench VerifiedClaude Opus 572.5%115 externally validated spatial-transcriptomics problems; bash, file editor and package managers; developer-reported8.17.2
LatchBio SpatialBench VerifiedClaude Mythos 569.2%reported by Anthropic in the Claude Opus 5 system card8.17.2
LatchBio SpatialBench VerifiedClaude Sonnet 567.8%reported by Anthropic in the Claude Opus 5 system card8.17.2
LatchBio SpatialBench VerifiedClaude Opus 4.866.6%reported by Anthropic in the Claude Opus 5 system card8.17.2
LatchBio SingleCellBenchClaude Opus 560.6%195 single-cell RNA-sequencing problems; developer-reported8.17.2
LatchBio SingleCellBenchClaude Mythos 559.3%reported by Anthropic in the Claude Opus 5 system card8.17.2
LatchBio SingleCellBenchClaude Opus 4.858.2%reported by Anthropic in the Claude Opus 5 system card8.17.2
LatchBio SingleCellBenchClaude Sonnet 556.2%reported by Anthropic in the Claude Opus 5 system card8.17.2
ProteinGym HardClaude Opus 547.7%rank correlation against published lab measurements; bash and file editor, no package managers; developer-reported8.17.3
ProteinGym HardClaude Mythos 545.8%reported by Anthropic in the Claude Opus 5 system card8.17.3
ProteinGym HardClaude Opus 4.840.0%reported by Anthropic in the Claude Opus 5 system card8.17.3
ProteinGym HardClaude Sonnet 536.6%reported by Anthropic in the Claude Opus 5 system card8.17.3
Protein DesignClaude Opus 542.5%scored by constraint satisfaction, folding confidence and sequence novelty; no tool access; developer-reported8.17.4
Protein DesignClaude Mythos 541.4%reported by Anthropic in the Claude Opus 5 system card8.17.4
Protein DesignClaude Opus 4.832.0%reported by Anthropic in the Claude Opus 5 system card8.17.4
Protein DesignClaude Sonnet 521.2%reported by Anthropic in the Claude Opus 5 system card8.17.4
Organic chemistry, V2Claude Opus 561.6%updated with harder expert-recommended problems; 10 of 1,260 attempts timed out and were excluded (≤±0.006 effect); developer-reported8.17.5
Organic chemistry, V2Claude Mythos 558.9%reported by Anthropic in the Claude Opus 5 system card8.17.5
Organic chemistry, V2Claude Opus 4.850.4%reported by Anthropic in the Claude Opus 5 system card8.17.5
Organic chemistry, V2Claude Sonnet 540.6%reported by Anthropic in the Claude Opus 5 system card8.17.5
Protocols — TroubleshootingClaude Opus 561.1%bash, file editor and web search available; developer-reported8.17.6
Protocols — TroubleshootingClaude Mythos 566.7%reported by Anthropic in the Claude Opus 5 system card8.17.6
Protocols — TroubleshootingClaude Sonnet 562.3%reported by Anthropic in the Claude Opus 5 system card8.17.6
Protocols — TroubleshootingClaude Opus 4.859.6%reported by Anthropic in the Claude Opus 5 system card8.17.6
Protocols — Understanding (Benchling)Claude Opus 578.4%variant created by Benchling; developer-reported8.17.6
Protocols — Understanding (Benchling)Claude Mythos 568.1%reported by Anthropic in the Claude Opus 5 system card8.17.6
Protocols — Understanding (Benchling)Claude Opus 4.862.3%reported by Anthropic in the Claude Opus 5 system card8.17.6
Protocols — Understanding (Benchling)Claude Sonnet 560.5%reported by Anthropic in the Claude Opus 5 system card8.17.6

Discrepancies noted

Table 5.2.2.3.A gives Claude Opus 5's browser-use attack success rate with thinking as 3.84% (11 of 129 attempts); the prose beneath it says the mitigations reduced the rate "from 11.15% to 3.70%". Table 8.1.A prints Mythos 5's HealthBench Professional score (66.011) in the Claude Fable 5 column; footnote 11 and figure 8.15.2.A attribute it to Mythos 5. The OSS-Fuzz figure's data labels (61.5 / 80.0 / 79.4 / 54.5) do not match the prose, which gives Opus 5 79.4% and Opus 4.8 38.5%; the prose figures are recorded above.

Provenance

Scraped from the Anthropic-hosted system card page at anthropic.com on September 19, 2026, including the August 19, 2026 changelog and the appendix (the Humanity's Last Exam and BrowseComp blocklists and the SWE-bench Multimodal test harness modifications). Figures are not reproduced in the capture; chart values appear as loose numbers beside their series labels, so some per-model figures in the card are not recoverable from the text.

Relationships