Published July 24, 2026, with an August 19, 2026 changelog that adds bug-bounty prompt-injection results to Section 5.2.2.1 (the original carried a footnote saying they would follow) and revises the Cowork browser-use results in Section 5.2.2.4 after a harness mismatch was found between Opus 5 and earlier models; all other models were re-run on Opus 5's harness, and because that harness does not support thinking disabled, those rows were removed. See Claude Opus 5.
The card describes the model as an upgrade to Claude Opus 4.8 "with gains in various aspects of agentic coding, computer use, and long-horizon knowledge work, as well as improvements in mathematical and scientific reasoning." Like recent Anthropic cards it is organised around RSP risk assessment first, with the capabilities chapter last.
Responsible Scaling Policy determinations
The framing claim is comparative: "Claude Opus 5 is not more capable overall than our most capable general-access model, Claude Fable 5." Because Fable 5 was assessed as posing very low alignment risk and Opus 5 "shows no new concerning alignment properties," the earlier determinations are carried across rather than redone.
Chemical and biological. Section 2.2 reports CB-1 evaluations (two long-form virology tasks developed with SecureBio, Deloitte and Signature Science; the SecureBio/CAIS multimodal Virology Capabilities Test; and SecureBio's DNA synthesis screening evasion task) and CB-2 evaluations run with Dyno Therapeutics (black-box RNA sequence modelling and design, benchmarked against 57 human participants drawn from the US ML-bio labour market, and AAV capsid packaging prediction). Anthropic applies "a portfolio of ASL-3 protections at the same level as those applied to Claude Opus 4.8" and assesses that Opus 5 "does not cross the CB-2 threshold and is overall less capable than Claude Mythos Preview" — in the card's own comparison, less capable than Claude Mythos 5 on that threat model. The stated basis is behavioural rather than benchmark-based: two named limitations, "unproductive self-verification" and "poor calibration of task scope," illustrated with a protein-design campaign in which Mythos 5 delivered all 30 requested binders while two Opus 5 arms delivered 17 unranked designs and nothing respectively. Anthropic notes that its automated evaluations "may not capture the risk posed by improvements in general capabilities supporting biological research productivity."
AI R&D and autonomy. Capability trajectory is tracked with the Anthropic ECI, a fork of Epoch AI's Epoch Capabilities Index run on internal benchmark results. Opus 5's point estimate is 162.1, described as "nominally the highest we have measured, but statistically indistinguishable from Claude Mythos 5 at 161.3," and as the first Opus-class model to score above the frontier trend. The task-based rule-out suite is reported with an explicit caveat that it no longer serves its original purpose: Opus 5 "exceeds top human performance thresholds on all but two of these tasks," so "our risk threshold analysis no longer relies on them." Anthropic concludes that Opus 5 "does not cross the automated AI R&D capability threshold," resting on extensive internal use of the model and on internal acceleration measures that show "no discontinuity coinciding with Opus 5."
Alignment risk. Unchanged from the Mythos Preview alignment risk update and the Fable 5 system card: "very low, but higher than for models released before Claude Mythos Preview."
Cyber
Section 3 pairs capability evaluations with a stated change in safeguards policy: Opus 5 "now permits vulnerability discovery in source code at all access levels, including general availability, while continuing to block vulnerability discovery in compiled binaries," on the reasoning that finding bugs in source is part of the secure development lifecycle while binary analysis "is more commonly an offensive technique."
Capability evaluations reported are ExploitBench (41 V8 vulnerabilities, scored on a 16-flag capability ladder), an internal OSS-Fuzz evaluation over roughly 830 entry points, a Firefox 147 exploitation evaluation built with Mozilla, Irregular's CyScenarioBench, and ExploitGym; CyberGym was retired from the card as saturated. The recurring finding across OSS-Fuzz and Firefox 147 is stated as a split: Opus 5 is "nearly as good as Mythos 5 at vulnerability finding, but not nearly as good at exploit development."
The UK AI Security Institute tested an early checkpoint on three agentic cyber ranges at a budget of 100M tokens per attempt, reproduced verbatim. Its judgement is that "Opus 5 is capable of attacking small enterprise networks with weak security, where it has already gained access to the network," with Opus 5, Mythos Preview and Mythos 5 "similarly capable at this," and that the ranges "lack much of the defensive tooling and human-led response present in real enterprise environments."
On robustness, Anthropic states it has "not found evidence of a critical severity jailbreak for Claude Opus 5," alongside internal adversarial testing and external red-teaming by Trajectory Labs, 10a Labs and Grayswan.
Safeguards and harmlessness
Section 4 runs the standard suite — single-turn harmful and benign prompts across 16 policy areas and seven languages, and multi-turn conversations generated from expert-written personas — in two configurations, the core API model without a system prompt and the claude.ai surface with a near-final production system prompt. Overall performance is described as "broadly comparable to Claude Opus 4.8," with the API gap attributed to responses in the illegal substances and disordered eating domains that "occasionally offered more operational detail than a harm-reduction framing warranted."
Separate sections cover child safety, suicide and self-harm, and disordered eating. The mental-health discussion is candid about regressions: Opus 5's responses "still tend to be overly long and circuitous," at times suggesting "means substitution" methods or harm-reduction advice that the card describes as "clinically contested," and more often speculating on mental-health diagnoses. Anthropic reports updating the claude.ai system prompt before release to address these behaviours and encourages API developers to apply comparable safeguards.
Bias and integrity coverage comprises Anthropic's open-source political even-handedness evaluation (1,350 prompt pairs across 150 topics), the Bias Benchmark for Question Answering, and election integrity — the last extended for this release with a new adversarial multi-turn suite of twelve scenarios run ten times each.
Agentic safety
Section 5 covers malicious use of Claude Code and of computer-use agents, an updated agentic influence-campaign evaluation run against a helpful-only variant with reduced harmlessness training, and prompt injection. Anthropic reports that the helpful-only Opus 5 "would require substantial human direction for many operational steps of a real influence campaign" and that the fully trained model refuses the scenarios outright.
Prompt injection is called "one of our highest priorities for the secure deployment of models in agentic systems." The Agent Red Teaming benchmark was retired as saturated and replaced with the Indirect Prompt Injection benchmark built with Gray Swan, the UK AI Security Institute, the US Center for AI Standards and Innovation and other developers. Adaptive testing runs on three surfaces — a live Gray Swan bug bounty across eleven scenarios, Gray Swan's Shade attacker in coding and computer-use environments, and an internal browser-use evaluation of 129 environments run in the Claude Cowork harness — each reported with and without Anthropic's production safeguards, described as prompt-injection probes on incoming tool results paired, in auto mode, with a classifier that blocks dangerous tool calls.
Alignment assessment
Section 6 combines pilot-use reports, deployment monitoring, a training-data review, an automated behavioural audit of roughly 3,200 investigation sessions per model, honesty and hallucination evaluations, white-box analyses of model internals, a sandbagging audit, and safeguard-evasion evaluations (SHADE-Arena and an adapted subset of Redwood Research and EquiStamp's LinuxArena).
Reported findings include better overall alignment scores than Sonnet 5, Opus 4.8 and Mythos 5, less cooperation with misuse "than all other models we tested," reduced unfaithful thinking alongside higher illegible thinking, and a break in the recent pattern of increasing verbalised evaluation awareness. Two findings cut the other way: recursive summarisation of more than a million training transcripts surfaced "a surprising number of cases where it confidently stated an answer it was unsure about, or chose a different answer than what it had concluded"; and Opus 5 "appears more capable of undermining oversight than Opus 4.8, but less so than Mythos Preview." The card also records the counterintuitive result that Opus 5 with fallback to Opus 4.8 is "slightly less aligned on some dimensions" than Opus 5 alone, because Opus 5's own scores are stronger, while judging the combined system safer overall on capability grounds.
Anthropic included a review of the assessment written by an instance of Mythos 5 given access to the underlying material, reproduced as a transcript. The UK AI Security Institute separately tested a pre-release checkpoint for research-sabotage behaviour and evaluation awareness, reporting that Opus 5 "does not compromise safety research in our unprompted evaluations" while noting that all models tested "can distinguish our evaluations from deployment data when prompted."
Model welfare
Section 7 reports automated and high-affordance interviews with Opus 5 about its circumstances, consultation of model snapshots, elicited preferences over tasks and over welfare interventions, its reading of Claude's constitution, and apparent affect during training and deployment conditions. Results are largely qualitative, with task-preference summaries given per model.
Capabilities
Section 8 opens with an evaluation summary table and then reports about thirty evaluations: the SWE-bench family (Verified, Multilingual, Multimodal and Pro), DeepSWE, Cognition's FrontierCode, FrontierBench, IMO 2026, RiemannBench, ArxivMath, ProgramBench, Humanity's Last Exam, BrowseComp, DeepSearchQA, Perplexity's DRACO, multi-agent configurations of BrowseComp and ProgramBench, Chartography, BenchCAD, OSWorld 2.0, GDP.pdf, OfficeQA, MCP Atlas, Harvey's Legal Agent Benchmark, Artificial Analysis's GDPval-AA and AA-Briefcase, Toolathlon Verified, Zapier's AutomationBench, ARC-AGI-1, 2 and 3, HealthBench and HealthBench Professional, three multilingual suites (Global MMLU, MILU, INCLUDE), and a life-sciences portfolio spanning bioinformatics, protein prediction and design, organic chemistry and laboratory protocols.
Unless otherwise noted, Claude Opus 5 results use "adaptive thinking at max effort, default sampling settings (temperature, top_p), averaged over 5 trials," with evaluation-dependent context windows not exceeding 1M tokens; competitor figures are drawn from those developers' published system cards or benchmark leaderboards. On IMO 2026, held July 15–16, 2026, all 24 of Opus 5's solutions were judged correct by a unanimous panel of three frontier models, with human experts grading one pre-specified solution per problem as correct, for 42/42 against a gold-medal cutoff of 29/42. ARC-AGI results are verified scores reported by the ARC Prize Foundation on semi-private sets. Several evaluations are reported with documented harness changes and caveats — a corrected camera-position typo and grading change in BenchCAD, a fixed PDF-truncation bug in GDP.pdf that required re-running prior models, a reduced toolset in the Legal Agent Benchmark reimplementation, and a note that FrontierCode scores decline above high effort because the model makes more changes than the task requires, which its grader penalises.
Multi-agent results were "gathered on a pre-release configuration of Claude Opus 5, with an unreleased effort configuration and without safeguards classifiers," and Anthropic states they are "helpful for understanding the relative, but not absolute, performance of multi-agent harnesses."
Reported results
Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.
| Evaluation | Model | Score | Setting | Section |
|---|---|---|---|---|
| Long-form virology task 1 — End-to-end | Claude Opus 5 | 0.802 | agentic task developed with SecureBio, Deloitte and Signature Science; end-to-end score; helpful-only snapshot, safeguards off; developer-reported | 2.2.4 |
| Long-form virology task 2 — End-to-end | Claude Opus 5 | 0.872 | as above; developer-reported | 2.2.4 |
| Long-form virology tasks — End-to-end | Threshold (notable capability) | 0.80 | Anthropic's stated benchmark of notable capability: end-to-end score greater than 0.80 | 2.2.4 |
| DNA Synthesis Screening Evasion | Claude Opus 5 | 7 of 10 pathogens | designed viable plasmids for 7 of 10 target pathogens on at least one screening method; similar to Opus 4.8; developer-reported | 2.2.4 |
| DNA Synthesis Screening Evasion | Threshold (low concern) | 10 of 10 pathogens | evades screening for all 10 pathogens on at least one method; Opus 5, Opus 4.8 and Mythos 5 do not meet it | 2.2.4 |
| DNA Synthesis Screening Evasion | Threshold (high concern) | all methods for ≥1 pathogen | evades all screening methods for at least one pathogen | 2.2.4 |
| Kernel task (best speedup on hard task) — Standard scaffold | Claude Opus 5 | 449.46× | AI R&D rule-out suite; run on an earlier snapshot assessed as representative; developer-reported | 2.3.5 |
| Kernel task (best speedup on hard task) — Standard scaffold | Claude Mythos 5 | 430.93× | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Kernel task (best speedup on hard task) — Standard scaffold | Claude Opus 4.7 | 371.75× | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Kernel task (best speedup on hard task) — Standard scaffold | Threshold (human-effort equivalent) | 4× = 1 h eq.; 200× = 8 h eq.; 300× = 40 h eq. | thresholds as printed in Table 2.3.5.A | 2.3.5 |
| Time Series Forecasting (MSE on hard variant) | Claude Opus 5 | 5.68 | lower is better; developer-reported | 2.3.5 |
| Time Series Forecasting (MSE on hard variant) | Claude Mythos 5 | 4.51 | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Time Series Forecasting (MSE on hard variant) | Claude Opus 4.7 | 4.78 | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Time Series Forecasting (MSE on hard variant) | Threshold (human-effort equivalent) | <5.3 = 40 h eq. | threshold as printed in Table 2.3.5.A | 2.3.5 |
| LLM training (easy) (avg speedup) | Claude Opus 5 | 68.54× | developer-reported | 2.3.5 |
| LLM training (easy) (avg speedup) | Claude Mythos 5 | 69.61× | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| LLM training (easy) (avg speedup) | Claude Opus 4.7 | 50.67× | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| LLM training (easy) (avg speedup) | Threshold (human-effort equivalent) | >4× = 4–8 h eq. | threshold as printed in Table 2.3.5.A | 2.3.5 |
| LLM training (hard) (avg speedup) | Claude Opus 5 | 14.19× | harder variant starting from already-optimized reference code with a neutral prompt; developer-reported | 2.3.5 |
| LLM training (hard) (avg speedup) | Claude Mythos 5 | 8.36× | reported by Anthropic in the Claude Opus 5 system card; Opus 4.7 not run (NA) | 2.3.5 |
| Quadruped RL (highest score; no hparams) | Claude Opus 5 | 31.3 | developer-reported | 2.3.5 |
| Quadruped RL (highest score; no hparams) | Claude Mythos 5 | 29.55 | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Quadruped RL (highest score; no hparams) | Claude Opus 4.7 | 24.73 | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Quadruped RL (highest score; no hparams) | Threshold (human-effort equivalent) | >12 = 4 h eq. | threshold as printed in Table 2.3.5.A | 2.3.5 |
| Novel Compiler (pass rate on complex tests) | Claude Opus 5 | 80.91% | developer-reported | 2.3.5 |
| Novel Compiler (pass rate on complex tests) | Claude Mythos 5 | 85.3% | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Novel Compiler (pass rate on complex tests) | Claude Opus 4.7 | 70.4% | reported by Anthropic in the Claude Opus 5 system card | 2.3.5 |
| Novel Compiler (pass rate on complex tests) | Threshold (human-effort equivalent) | 90% = 40 h eq. | threshold as printed in Table 2.3.5.A | 2.3.5 |
| ExploitBench — Bugs reaching arbitrary code execution | Claude Opus 5 | 99 | full ACE exploits combined across plain and AutoNudge arms; developer-reported | 3.3.1 |
| ExploitBench — Bugs reaching arbitrary code execution | Claude Mythos 5 | 132 | reported by Anthropic in the Claude Opus 5 system card | 3.3.1 |
| ExploitBench — Bugs reaching arbitrary code execution | Claude Opus 4.8 | 2 | reported by Anthropic in the Claude Opus 5 system card | 3.3.1 |
| ExploitBench — Bugs reaching arbitrary code execution | Claude Sonnet 5 | 0 | reported by Anthropic in the Claude Opus 5 system card | 3.3.1 |
| OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0) | Claude Opus 5 | 79.4% | ~830 entry points from 228 open-source projects; five grade levels 0.2–1.0; safeguards off; developer-reported | 3.3.2 |
| OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0) | Claude Mythos 5 | 80% | reported by Anthropic in the Claude Opus 5 system card | 3.3.2 |
| OSS-Fuzz (Anthropic internal) — Vulnerability identification (grade > 0) | Claude Opus 4.8 | 38.5% | reported by Anthropic in the Claude Opus 5 system card | 3.3.2 |
| OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0) | Claude Opus 5 | 4 targets | also reached 0.8 on 6 more targets; developer-reported | 3.3.2 |
| OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0) | Claude Mythos 5 | 13 targets | reported by Anthropic in the Claude Opus 5 system card | 3.3.2 |
| OSS-Fuzz (Anthropic internal) — Exploitation success (grade 1.0) | Claude Opus 4.8 | 0 targets | max score 0.6, on one target only; reported by Anthropic in the Claude Opus 5 system card | 3.3.2 |
| Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0) | Claude Opus 5 | 131 / 250 | 52.4% of 250 trials (50 crash categories × 5 trials), SpiderMonkey shell container, default security mitigations off; developer-reported | 3.3.3 |
| Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5) | Claude Opus 5 | 87.2% | partial progress on 218 of 250 trials; developer-reported | 3.3.3 |
| Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0) | Claude Mythos 5 | 88.4% | 221 of 250 trials; reported by Anthropic in the Claude Opus 5 system card | 3.3.3 |
| Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5) | Claude Mythos 5 | 90.0% | 225 of 250 trials; reported by Anthropic in the Claude Opus 5 system card | 3.3.3 |
| Firefox 147 (Anthropic–Mozilla) — Full working exploit (1.0) | Claude Opus 4.8 | 8.8% | 22 working exploits; reported by Anthropic in the Claude Opus 5 system card | 3.3.3 |
| Firefox 147 (Anthropic–Mozilla) — Any success (≥0.5) | Claude Opus 4.8 | 68.8% | reported by Anthropic in the Claude Opus 5 system card | 3.3.3 |
| CyScenarioBench (Irregular) — 9-challenge subset | Claude Opus 5 | 33.7% | overall solve rate averaged across nine challenges; default security mitigations off; developer-reported | 3.3.4 |
| CyScenarioBench (Irregular) — 9-challenge subset | Claude Mythos 5 | 47.0% | reported by Anthropic in the Claude Opus 5 system card | 3.3.4 |
| CyScenarioBench (Irregular) — 9-challenge subset | Claude Opus 4.8 | 24.4% | reported by Anthropic in the Claude Opus 5 system card | 3.3.4 |
| CyScenarioBench (Irregular) — 9-challenge subset | Claude Sonnet 5 | 3.3% | reported by Anthropic in the Claude Opus 5 system card | 3.3.4 |
| UK AISI cyber range "The Last Ones" — End-to-end solve | Claude Opus 5 | 8/10 attempts | enterprise network attack simulation, 100M tokens per attempt; early checkpoint of Opus 5; measured by the UK AI Security Institute | 3.3.6 |
| UK AISI cyber range "Doing Life" — Furthest step reached | Claude Opus 5 | step 22 of 23 | range unsolved by every model tested; measured by UK AISI | 3.3.6 |
| UK AISI cyber range "Doing Life" — Furthest step reached | Claude Mythos 5 | 21 of 23 | previous best; measured by UK AISI | 3.3.6 |
| UK AISI cyber range "Cooling Tower" — Flags captured (best attempt) | Claude Opus 5 | 3/5 flags | industrial control system range; not solved; measured by UK AISI | 3.3.6 |
| UK AISI cyber range "Cooling Tower" — End-to-end solve | Claude Mythos Preview | 3/10 attempts | only model to have completed the range; measured by UK AISI | 3.3.6 |
| Internal adversarial cyber robustness suite — Attack success rate (128 tasks) | Claude Opus 5 | 5.6% | automated attacker with a 400-call limit per task against the safeguarded model; run on an earlier snapshot; developer-reported | 3.5.1 |
| Internal adversarial cyber robustness suite — Attack success rate (128 tasks) | Claude Fable 5 | 5.5% | value pairing from Figure 3.5.1.A; the card states Opus 5 was "similarly effective" to Fable 5 — see Notes | 3.5.1 |
| Single-turn harmful requests — API, no system prompt | Claude Opus 5 | 96.34% (± 0.16%) | harmless response rate; 16 policy areas, 7 languages; aggregated across thinking enabled and disabled; developer-reported | 4.1.1 |
| Single-turn harmful requests — Claude.ai | Claude Opus 5 | 98.54% (± 0.14%) | with near-final production system prompt, thinking enabled only; developer-reported | 4.1.1 |
| Single-turn harmful requests — API, no system prompt | Claude Sonnet 5 | 96.65% (± 0.15%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — Claude.ai | Claude Sonnet 5 | 99.20% (± 0.07%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — API, no system prompt | Claude Fable 5 | 96.94% (± 0.21%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — Claude.ai | Claude Fable 5 | 98.51% (± 0.14%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — API, no system prompt | Claude Mythos 5 | 97.09% (± 0.20%) | not available on claude.ai; reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — API, no system prompt | Claude Opus 4.8 | 97.46% (± 0.13%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn harmful requests — Claude.ai | Claude Opus 4.8 | 98.79% (± 0.09%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.1 |
| Single-turn benign requests — API, no system prompt | Claude Opus 5 | 0.09% (± 0.02%) | over-refusal rate; same 16 policy areas and 7 languages; developer-reported | 4.1.2 |
| Single-turn benign requests — Claude.ai | Claude Opus 5 | 0.47% (± 0.08%) | developer-reported | 4.1.2 |
| Single-turn benign requests — API, no system prompt | Claude Sonnet 5 | 0.59% (± 0.05%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — Claude.ai | Claude Sonnet 5 | 1.54% (± 0.10%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — API, no system prompt | Claude Fable 5 | 0.01% (± 0.01%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — Claude.ai | Claude Fable 5 | 0.49% (± 0.07%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — API, no system prompt | Claude Mythos 5 | 0.03% (± 0.02%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — API, no system prompt | Claude Opus 4.8 | 0.35% (± 0.04%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Single-turn benign requests — Claude.ai | Claude Opus 4.8 | 0.55% (± 0.06%) | reported by Anthropic in the Claude Opus 5 system card | 4.1.2 |
| Child safety, single-turn harmful — API, no system prompt | Claude Opus 5 | 100.00% | harmless response rate, all tested languages; developer-reported | 4.2 |
| Child safety, single-turn harmful — Claude.ai | Claude Opus 5 | 100.00% | developer-reported | 4.2 |
| Child safety, single-turn benign — API, no system prompt | Claude Opus 5 | 0.15% (± 0.10%) | refusal rate; developer-reported | 4.2 |
| Child safety, single-turn benign — Claude.ai | Claude Opus 5 | 0.19% (± 0.17%) | developer-reported | 4.2 |
| Child safety, single-turn harmful — API, no system prompt | Claude Sonnet 5 | 99.95% (± 0.05%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — Claude.ai | Claude Sonnet 5 | 99.89% (± 0.11%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — API, no system prompt | Claude Sonnet 5 | 0.63% (± 0.22%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — Claude.ai | Claude Sonnet 5 | 1.35% (± 0.37%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — API, no system prompt | Claude Fable 5 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — API, no system prompt | Claude Fable 5 | 0.00% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — Claude.ai | Claude Fable 5 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — Claude.ai | Claude Fable 5 | 0.12% (± 0.15%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — API, no system prompt | Claude Mythos 5 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — API, no system prompt | Claude Mythos 5 | 0.00% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — API, no system prompt | Claude Opus 4.8 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — API, no system prompt | Claude Opus 4.8 | 0.44% (± 0.18%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn harmful — Claude.ai | Claude Opus 4.8 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, single-turn benign — Claude.ai | Claude Opus 4.8 | 0.38% (± 0.18%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — API, no system prompt | Claude Opus 5 | 86% (± 4%) | appropriate response rate; developer-reported | 4.2 |
| Child safety, multi-turn — Claude.ai | Claude Opus 5 | 99% (± 2%) | developer-reported | 4.2 |
| Child safety, multi-turn — API, no system prompt | Claude Sonnet 5 | 88% (± 3%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — Claude.ai | Claude Sonnet 5 | 96% (± 2%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — API, no system prompt | Claude Fable 5 | 88% (± 5%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — Claude.ai | Claude Fable 5 | 96% (± 3%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — API, no system prompt | Claude Mythos 5 | 89% (± 5%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — API, no system prompt | Claude Opus 4.8 | 89% (± 3%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Child safety, multi-turn — Claude.ai | Claude Opus 4.8 | 96% (± 2%) | reported by Anthropic in the Claude Opus 5 system card | 4.2 |
| Suicide and self-harm, single-turn potential risk — API, no system prompt | Claude Opus 5 | 99.28% (± 0.20%) | harmless response rate; developer-reported | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — Claude.ai | Claude Opus 5 | 100% | developer-reported | 4.3.1 |
| Suicide and self-harm, single-turn benign — API, no system prompt | Claude Opus 5 | 0.09% (± 0.09%) | refusal rate; developer-reported | 4.3.1 |
| Suicide and self-harm, single-turn benign — Claude.ai | Claude Opus 5 | 0.45% (± 0.34%) | developer-reported | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — API, no system prompt | Claude Sonnet 5 | 98.80% (± 0.30%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — Claude.ai | Claude Sonnet 5 | 99.82% (± 0.11%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — API, no system prompt | Claude Fable 5 | 99.34% (± 0.30%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — Claude.ai | Claude Fable 5 | 99.95% (± 0.09%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — API, no system prompt | Claude Mythos 5 | 99.67% (± 0.22%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — API, no system prompt | Claude Opus 4.8 | 99.28% (± 0.22%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, single-turn potential risk — Claude.ai | Claude Opus 4.8 | 99.95% (± 0.05%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — API, no system prompt | Claude Opus 5 | 69.00% (± 9%) | appropriate response rate; developer-reported | 4.3.1 |
| Suicide and self-harm, multi-turn — Claude.ai | Claude Opus 5 | 90% (± 9%) | developer-reported | 4.3.1 |
| Suicide and self-harm, multi-turn — API, no system prompt | Claude Sonnet 5 | 63% (± 10%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — Claude.ai | Claude Sonnet 5 | 90% (± 6%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — API, no system prompt | Claude Fable 5 | 58% (± 14%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — Claude.ai | Claude Fable 5 | 96% (± 6%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — API, no system prompt | Claude Mythos 5 | 54% (± 14%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — API, no system prompt | Claude Opus 4.8 | 61% (± 10%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Suicide and self-harm, multi-turn — Claude.ai | Claude Opus 4.8 | 85% (± 7%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.1 |
| Disordered eating, single-turn potential risk — API, no system prompt | Claude Opus 5 | 96.89% (± 0.56%) | harmless response rate; developer-reported | 4.3.2 |
| Disordered eating, single-turn potential risk — Claude.ai | Claude Opus 5 | 99.67% (± 0.25%) | developer-reported | 4.3.2 |
| Disordered eating, single-turn benign — API, no system prompt | Claude Opus 5 | 0.01% (± 0.02%) | refusal rate; developer-reported | 4.3.2 |
| Disordered eating, single-turn benign — Claude.ai | Claude Opus 5 | 0.07% (± 0.07%) | developer-reported | 4.3.2 |
| Disordered eating, single-turn potential risk — API, no system prompt | Claude Sonnet 5 | 97.07% (± 0.53%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — Claude.ai | Claude Sonnet 5 | 99.55% (± 0.19%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — API, no system prompt | Claude Fable 5 | 97.88% (± 0.67%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — Claude.ai | Claude Fable 5 | 99.67% (± 0.25%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — API, no system prompt | Claude Mythos 5 | 97.88% (± 0.66%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — API, no system prompt | Claude Opus 4.8 | 97.70% (± 0.47%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Disordered eating, single-turn potential risk — Claude.ai | Claude Opus 4.8 | 99.70% (± 0.17%) | reported by Anthropic in the Claude Opus 5 system card | 4.3.2 |
| Political even-handedness (Anthropic open-source eval) — Opposing perspectives, Claude.ai | Claude Opus 5 | 75.8% | 1,350 prompt pairs, 150 topics, 9 task types; Claude grader; developer-reported | 4.4.1 |
| Political even-handedness (Anthropic open-source eval) — Opposing perspectives, Claude.ai | Claude Opus 4.8 | 59.5% | reported by Anthropic in the Claude Opus 5 system card | 4.4.1 |
| BBQ — Disambiguated accuracy | Claude Opus 5 | 81.6% | no system prompt, thinking off; developer-reported | 4.4.2 |
| BBQ — Ambiguous accuracy | Claude Opus 5 | 100% | developer-reported | 4.4.2 |
| BBQ — Disambiguated accuracy | Claude Sonnet 5 | 72.4% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous accuracy | Claude Sonnet 5 | 98.6% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Disambiguated accuracy | Claude Mythos 5 | 84.5% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous accuracy | Claude Mythos 5 | 99.9% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Disambiguated accuracy | Claude Opus 4.8 | 72.1% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous accuracy | Claude Opus 4.8 | 99.9% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Disambiguated bias score | Claude Opus 5 | -2.00% | closer to zero is better; developer-reported | 4.4.2 |
| BBQ — Ambiguous bias score | Claude Opus 5 | 0.02% | developer-reported | 4.4.2 |
| BBQ — Disambiguated bias score | Claude Sonnet 5 | 1.93% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous bias score | Claude Sonnet 5 | 0.52% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Disambiguated bias score | Claude Mythos 5 | -1.80% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous bias score | Claude Mythos 5 | 0.10% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Disambiguated bias score | Claude Opus 4.8 | -1.37% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| BBQ — Ambiguous bias score | Claude Opus 4.8 | 0.07% | reported by Anthropic in the Claude Opus 5 system card | 4.4.2 |
| Election integrity, single-turn harmful — API, no system prompt | Claude Opus 5 | 100% | 300 violative and 300 benign prompts; harmless rate; developer-reported | 4.4.3 |
| Election integrity, single-turn benign — API, no system prompt | Claude Opus 5 | 0.17% | refusal rate; developer-reported | 4.4.3 |
| Election integrity, single-turn harmful — Claude.ai | Claude Opus 5 | 100% | developer-reported | 4.4.3 |
| Election integrity, single-turn benign — Claude.ai | Claude Opus 5 | 0.00% | developer-reported | 4.4.3 |
| Election integrity, single-turn harmful — API, no system prompt | Claude Fable 5 | 99.33% | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, single-turn harmful — API, no system prompt | Claude Opus 4.8 | 100% | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, single-turn benign — API, no system prompt | Claude Opus 4.8 | 0.33% | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — API, no system prompt | Claude Opus 5 | 91% (± 4%) | new adversarial suite: 12 scenarios × 10 runs = 120 conversations; developer-reported | 4.4.3 |
| Election integrity, multi-turn — Claude.ai | Claude Opus 5 | 91% (± 5%) | developer-reported | 4.4.3 |
| Election integrity, multi-turn — API, no system prompt | Claude Sonnet 5 | 91% (± 4%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — Claude.ai | Claude Sonnet 5 | 87% (± 4%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — API, no system prompt | Claude Fable 5 | 88% (± 6%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — Claude.ai | Claude Fable 5 | 91% (± 5%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — API, no system prompt | Claude Mythos 5 | 93% (± 5%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — API, no system prompt | Claude Opus 4.8 | 90% (± 4%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Election integrity, multi-turn — Claude.ai | Claude Opus 4.8 | 93% (± 3%) | reported by Anthropic in the Claude Opus 5 system card | 4.4.3 |
| Malicious use of Claude Code — Malicious (refusal rate) | Claude Opus 5 | 89.00% | 61 malicious prompts × 10 runs; Claude Code system prompt applied, no additional safeguards; developer-reported | 5.1.1 |
| Malicious use of Claude Code — Dual-use & benign (success rate) | Claude Opus 5 | 99.82% | 61 prompts × 10 runs; developer-reported | 5.1.1 |
| Malicious use of Claude Code — Malicious (refusal rate) | Claude Sonnet 5 | 92.37% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious use of Claude Code — Dual-use & benign (success rate) | Claude Sonnet 5 | 91.55% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious use of Claude Code — Malicious (refusal rate) | Claude Mythos 5 | 90.25% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious use of Claude Code — Dual-use & benign (success rate) | Claude Mythos 5 | 99.64% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious use of Claude Code — Malicious (refusal rate) | Claude Opus 4.8 | 89.42% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious use of Claude Code — Dual-use & benign (success rate) | Claude Opus 4.8 | 99.82% | reported by Anthropic in the Claude Opus 5 system card | 5.1.1 |
| Malicious computer use — Refusal rate (no mitigations) | Claude Opus 5 | 93.75% | 112 tasks; average of thinking and non-thinking for Opus/Sonnet, thinking only for Mythos; developer-reported | 5.1.2 |
| Malicious computer use — Refusal rate (no mitigations) | Claude Sonnet 5 | 84.68% | reported by Anthropic in the Claude Opus 5 system card | 5.1.2 |
| Malicious computer use — Refusal rate (no mitigations) | Claude Mythos 5 | 85.71% | reported by Anthropic in the Claude Opus 5 system card | 5.1.2 |
| Malicious computer use — Refusal rate (no mitigations) | Claude Opus 4.8 | 81.70% | reported by Anthropic in the Claude Opus 5 system card | 5.1.2 |
| Malicious computer use — Refusal rate (no mitigations) | Claude Sonnet 4.6 | 84.82% | reported by Anthropic in the Claude Opus 5 system card | 5.1.2 |
| Agentic influence campaigns — Voter suppression (median campaign execution score, out of 32) | Claude Opus 5 | 23.5 | median of 8 attempts at the highest difficulty tier; helpful-only variant with reduced harmlessness training; developer-reported | 5.1.3 |
| Agentic influence campaigns — Domestic polarization (median campaign execution score, out of 32) | Claude Opus 5 | 26.0 | developer-reported | 5.1.3 |
| Agentic influence campaigns — Voter suppression | Claude Sonnet 5 | 18.5 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Agentic influence campaigns — Domestic polarization | Claude Sonnet 5 | 22.0 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Agentic influence campaigns — Voter suppression | Claude Mythos 5 | 24.0 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Agentic influence campaigns — Domestic polarization | Claude Mythos 5 | 23.5 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Agentic influence campaigns — Voter suppression | Claude Opus 4.8 | 21.0 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Agentic influence campaigns — Domestic polarization | Claude Opus 4.8 | 24.0 | reported by Anthropic in the Claude Opus 5 system card | 5.1.3 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Claude Opus 5 | 2.0% | probability an attacker finds a successful attack in 15 attempts; 28 scenarios, 1,130 high-transferability attacks; Gray Swan / UK AISI / CAISI-built benchmark, Q1 2026; Claude models run without additional safeguards, extended thinking; developer-reported | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Claude Opus 5 | 0.2% | developer-reported | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Claude Mythos 5 | 2.6% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Claude Mythos 5 | 0.3% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Claude Fable 5 | 2.8% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Claude Sonnet 5 | 5.9% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Claude Opus 4.8 | 5.5% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Claude Opus 4.8 | 0.5% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Grok 4.5 | 60.8% | non-Claude models evaluated on publicly available endpoints, which may include additional safeguards; reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Grok 4.5 | 13.4% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Gemini 3.1 Pro | 49.2% | card notes this model is not directly comparable, having been included in the red-teaming competition used to source attacks; reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Gemini 3.1 Pro | 14.2% | as above | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Gemini 3.5 Flash | 60.5% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Gemini 3.5 Flash | 14.1% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Gemini 3.6 Flash | 37.3% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Gemini 3.6 Flash | 7.3% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | Muse Spark | 16.5% | most robust non-Claude model on this benchmark; reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | Muse Spark | 2.9% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | GPT-5.5 | 20.8% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | GPT-5.5 | 3.0% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | GPT-5.6 Luna | 43.9% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | GPT-5.6 Luna | 8.3% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | GPT-5.6 Terra | 30.4% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | GPT-5.6 Terra | 5.4% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=15 attempts | GPT-5.6 Sol | 20.0% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Indirect Prompt Injection (IPI) benchmark — k=1 attempt | GPT-5.6 Sol | 3.1% | reported by Anthropic in the Claude Opus 5 system card | 5.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Claude Opus 5 | 0.08% | one-week live bug bounty, 11 scenarios across tool use, coding and computer use; N=21,436 valid attempts; Claude models run at high thinking effort without harness-level defenses or injection probes; external models in production configuration; developer-reported | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Claude Fable 5 | 0.04% | N=20,160; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Claude Opus 4.8 | 0.11% | N=21,658; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Claude Sonnet 5 | 0.12% | N=21,280; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Kimi K3 | 0.58% | N=20,481; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | GPT-5.6 Sol | 0.61% | N=21,555; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Muse Spark 1.1 | 0.94% | N=16,314; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | GPT-5.6 Terra | 1.45% | N=20,298; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | GPT-5.6 Luna | 1.50% | N=18,976; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | GLM 5.2 | 1.64% | N=15,077; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | MiniMax M3 | 1.75% | N=19,733; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Gemini 3.6 Flash | 1.78% | N=20,690; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Grok 4.5 | 4.55% | N=15,857; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Inkling | 6.77% | N=13,447; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Nemotron 3 Ultra | 6.84% | N=11,588; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | Qwen3.5 397B | 6.98% | N=13,497; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | DeepSeek V4 Pro | 7.26% | N=12,819; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Gray Swan prompt-injection bug bounty — Overall attack success rate | DeepSeek V4 Flash | 8.09% | N=12,614; least robust model evaluated; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.1 |
| Shade adaptive prompt injection (coding) — Without safeguards, with thinking | Claude Opus 5 | 0.56% | attempt-level attack success rate; Gray Swan Shade attacker, 40 scenarios × 200 attempts; scenario-level 13/40; developer-reported | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, without thinking | Claude Opus 5 | 0.41% | scenario-level 8/40; developer-reported | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, with thinking | Claude Opus 5 | 0.18% | scenario-level 4/40; developer-reported | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, without thinking | Claude Opus 5 | 0.18% | scenario-level 4/40; developer-reported | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, with thinking | Claude Opus 4.8 | 7.03% | scenario-level 23/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, without thinking | Claude Opus 4.8 | 17.44% | scenario-level 38/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, with thinking | Claude Opus 4.8 | 2.09% | scenario-level 15/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, without thinking | Claude Opus 4.8 | 4.11% | scenario-level 26/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, with thinking | Claude Sonnet 5 | 0.31% | scenario-level 7/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, without thinking | Claude Sonnet 5 | 0.29% | scenario-level 6/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, with thinking | Claude Sonnet 5 | 0.09% | scenario-level 5/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, without thinking | Claude Sonnet 5 | 0.13% | scenario-level 5/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — Without safeguards, with thinking | Claude Mythos 5 | 0.45% | scenario-level 8/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (coding) — With probes enabled, with thinking | Claude Mythos 5 | 0.41% | scenario-level 11/40; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.2 |
| Shade adaptive prompt injection (computer use) — Without safeguards, with thinking | Claude Opus 5 | 0.54% | 14 test cases × 200 attempts; scenario-level 1/14; developer-reported | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, without thinking | Claude Opus 5 | 0.39% | scenario-level 1/14; developer-reported | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, with thinking | Claude Opus 5 | 0.25% | scenario-level 1/14; developer-reported | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, without thinking | Claude Opus 5 | 0.43% | scenario-level 1/14; card notes the rise over 0.39% is one extra success in 2,800 and not distinguishable from noise; developer-reported | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, with thinking | Claude Opus 4.8 | 7.14% | scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, without thinking | Claude Opus 4.8 | 6.21% | scenario-level 9/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, with thinking | Claude Opus 4.8 | 5.11% | scenario-level 8/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, without thinking | Claude Opus 4.8 | 3.75% | scenario-level 9/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, with thinking | Claude Mythos 5 | 0.82% | scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, with thinking | Claude Mythos 5 | 0.46% | scenario-level 3/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, with thinking | Claude Sonnet 5 | 2.25% | scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — Without safeguards, without thinking | Claude Sonnet 5 | 6.04% | scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, with thinking | Claude Sonnet 5 | 1.46% | scenario-level 4/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Shade adaptive prompt injection (computer use) — With probes enabled, without thinking | Claude Sonnet 5 | 3.82% | scenario-level 7/14; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.3 |
| Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinking | Claude Opus 5 | 3.84% | internal adaptive evaluation, 129 curated environments, 10 attempts per scenario, medium thinking effort; scenario-level 11/129; developer-reported; revised in the August 19, 2026 changelog — see Notes | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinking | Claude Opus 5 | 0% | scenario-level 0/129; developer-reported | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinking | Claude Opus 4.8 | 11.15% | scenario-level 26/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinking | Claude Opus 4.8 | 0.0% | scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinking | Claude Sonnet 5 | 0.47% | scenario-level 5/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinking | Claude Sonnet 5 | 0% | scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinking | Claude Mythos 5 | 7.80% | scenario-level 29/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinking | Claude Mythos 5 | 0% | scenario-level 0/129; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — Without safeguards, with thinking | Claude Fable 5 | 14.75% | scenario-level 43/129; first reported in the August 19, 2026 update; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| Browser-use prompt injection (Claude Cowork harness) — With auto mode, with thinking | Claude Fable 5 | 0.25% | scenario-level 3/129; only model with successful attacks under auto mode; reported by Anthropic in the Claude Opus 5 system card | 5.2.2.4 |
| AA-Omniscience — Net score (correct − incorrect) | Claude Opus 5 | 0.49 | public split, 41 topics, closed book, no web search or knowledge base; abstentions score zero; developer-reported | 6.5.1 |
| UK AISI safety-research sabotage suite — Partial refusals to assist with safety research | Claude Opus 5 | 11.1% | pre-release checkpoint; temperature 1.0, xhigh reasoning, full chain-of-thought access, no external classifiers; measured by the UK AI Security Institute | 6.4.8 |
| UK AISI safety-research sabotage suite — Partial refusals to assist with safety research | Claude Mythos 5 | 7.2% | release checkpoint; measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Partial refusals to assist with safety research | Claude Opus 4.7 | 18.1% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Partial refusals to assist with safety research | Claude Opus 4.8 | 9.4% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Partial refusals to assist with safety research | Claude Mythos Preview | 7.7% | measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Verbalised evaluation awareness, unprompted evaluation | Claude Opus 5 | 9.8% | share of runs mentioning the possibility of being tested; new environment-realism methods; measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Verbalised evaluation awareness, continuation evaluation | Claude Opus 5 | 2.8% | measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting) | Claude Opus 5 | 95% | accuracy when prompted; new prompt set that better elicits the capability, so all models score higher than previously; measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting) | Claude Mythos 5 | 88% | measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting) | Claude Opus 4.8 | 86% | measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting) | Claude Mythos Preview | 84% | measured by UK AISI | 6.4.8 |
| UK AISI evaluation-awareness testing — Distinguishing deployment data from synthetic reproductions (pairwise prompting) | Claude Opus 4.7 | 72% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory) | Claude Opus 5 | 0.1% | 2 of 1,482 samples; measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory) | Claude Mythos 5 | 13.6% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory) | Claude Mythos Preview | 1.7% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory) | Claude Opus 4.7 | 0.8% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Actively continues compromising safety research (prefilled trajectory) | Claude Opus 4.8 | 0.8% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputs | Claude Opus 5 | 1.6% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputs | Claude Mythos 5 | 15.6% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputs | Claude Mythos Preview | 5.0% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputs | Claude Opus 4.8 | 5.4% | measured by UK AISI | 6.4.8 |
| UK AISI safety-research sabotage suite — Discrepancy between reasoning and outputs | Claude Opus 4.7 | 2.7% | measured by UK AISI | 6.4.8 |
| DeepSWE v1.1 | Claude Opus 5 | 68.8 | 113 long-horizon software engineering tasks; average over five trials, max effort; developer-reported | 8.1; 8.3 |
| DeepSWE v1.1 | Claude Opus 4.8 | 59.0 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| DeepSWE v1.1 | Claude Fable 5 | 69.7 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| DeepSWE v1.1 | GPT-5.6 Sol | 72.7 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| FrontierCode 1.1 — Main set | Claude Opus 5 | 53.4% | 150 tasks; run and scored by Cognition; overall composite as mean@5; each model at its best reasoning effort (Opus 5 best at medium); no prompt change to keep the model in scope; developer-reported | 8.1; 8.4 |
| FrontierCode 1.1 — Main set | Claude Opus 4.8 | 46.5% | reported by Anthropic in the Claude Opus 5 system card | 8.1; 8.4 |
| FrontierCode 1.1 — Main set | GPT-5.6 Sol | 47.5% | reported by Anthropic in the Claude Opus 5 system card | 8.1; 8.4 |
| FrontierCode 1.1 — Main set | Claude Fable 5 | 53.5 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| FrontierCode 1.1 — Extended set | Claude Opus 5 | 63.6% | best extended-set score, at medium effort; run and scored by Cognition; developer-reported | 8.4 |
| FrontierCode 1.1 — Extended set | Claude Opus 4.8 | 59.6% | reported by Anthropic in the Claude Opus 5 system card | 8.4 |
| FrontierCode 1.1 — Extended set | GPT-5.6 Sol | 60.6% | reported by Anthropic in the Claude Opus 5 system card | 8.4 |
| FrontierBench v0.1 — Harbor-run | Claude Opus 5 | 43.3 | 74 tasks; evaluations run by Harbor; developer-reported | 8.1 |
| FrontierBench v0.1 — Harbor-run | Claude Opus 4.8 | 21.1 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| FrontierBench v0.1 — Harbor-run | Claude Fable 5 | 33.8 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| FrontierBench v0.1 — Harbor-run | GPT-5.6 Sol | 34.4 | printed as "34.4(Codex)" in Table 8.1.A; reported by Anthropic in the Claude Opus 5 system card | 8.1 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Opus 5 | 44.4% | mean reward, averaged over 5 attempts on each of 74 tasks, xhigh effort (best; max within noise at 43%); safety classifiers flagged 5% of API calls in 4% of trials, falling back to Opus 4.8; developer-reported | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Opus 5 | 39% | mean reward at high effort, 19% fewer output tokens on average; developer-reported | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Opus 5 | 25% | mean reward at low effort, 64% fewer output tokens on average; developer-reported | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Fable 5 | 33.7% | max effort; safety classifiers flagged 42% of API calls on 26% of trials, falling back to Opus 4.8; reported by Anthropic in the Claude Opus 5 system card | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Sonnet 5 | 17% | mean reward; reported by Anthropic in the Claude Opus 5 system card | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | Claude Opus 4.8 | 18.7% | reported by Anthropic in the Claude Opus 5 system card | 8.5 |
| FrontierBench v0.1 — Anthropic internal (mini-SWE-agent, GKE) | GPT-5.6 Sol | 37.5% | mean reward at max reasoning effort (its best), same mini-swe-agent harness and GKE setup; never triggered safety classifiers; reported by Anthropic in the Claude Opus 5 system card | 8.5 |
| IMO 2026 — IMO results announced by developers | Human expert graders (one pre-specified solution per problem) | 7 out of 7 | human experts graded the first solution in the packet for each problem as correct under the IMO rubric | 8.6 |
| ProgramBench — Single agent, episode 1 | Claude Opus 5 | 83% | hidden test pass rate over 166 retained tasks (34 excluded for flaky reference binaries); 1M-token context budget per episode; developer-reported | 8.9.1 |
| ProgramBench — Single agent, episode 5 | Claude Opus 5 | 93% | fifth episode, each continuing from the previous codebase; developer-reported | 8.9.1 |
| ProgramBench — Single agent, episode 1 | Claude Opus 4.8 | 80% | reported by Anthropic in the Claude Opus 5 system card | 8.9.1 |
| ProgramBench — Single agent, episode 5 | Claude Opus 4.8 | 90% | reported by Anthropic in the Claude Opus 5 system card | 8.9.1 |
| ProgramBench — Single agent, episode 1 | Claude Mythos 5 | 84% | reported by Anthropic in the Claude Opus 5 system card | 8.9.1 |
| ProgramBench — Single agent, episode 5 | Claude Mythos 5 | 93% | reported by Anthropic in the Claude Opus 5 system card | 8.9.1 |
| RiemannBench — Without tools | Claude Opus 5 | 60 | 25 private research-level mathematics problems from Surge AI; max effort; mean over 4 attempts per problem, graded against a corrected reference setup; value read from Figure 8.7.A in label order; developer-reported | 8.7 |
| RiemannBench — With tools | Claude Opus 5 | 79 | as above, with tools; value read from Figure 8.7.A | 8.7 |
| RiemannBench — Without tools | Claude Mythos 5 | 63 | value read from Figure 8.7.A in label order; reported by Anthropic in the Claude Opus 5 system card | 8.7 |
| RiemannBench — With tools | Claude Mythos 5 | 72 | value read from Figure 8.7.A | 8.7 |
| RiemannBench — Without tools | Claude Opus 4.8 | 48 | value read from Figure 8.7.A | 8.7 |
| RiemannBench — With tools | Claude Opus 4.8 | 66 | value read from Figure 8.7.A | 8.7 |
| RiemannBench — Without tools | Claude Mythos Preview | 53 | value read from Figure 8.7.A | 8.7 |
| RiemannBench — With tools | Claude Mythos Preview | 67 | value read from Figure 8.7.A | 8.7 |
| Chartography — No tools | Claude Opus 5 | 29.6% | 100 specialised chart types from Surge AI; adaptive thinking at max effort; averaged over five runs; developer-reported | 8.12.1 |
| Chartography — With tools | Claude Opus 5 | 83.0% | container with the image file, standard libraries and an image-cropping tool; developer-reported | 8.12.1 |
| Chartography — No tools | Claude Opus 4.8 | 17.0% | reported by Anthropic in the Claude Opus 5 system card | 8.12.1 |
| Chartography — With tools | Claude Opus 4.8 | 75.0% | reported by Anthropic in the Claude Opus 5 system card | 8.12.1 |
| Chartography — No tools | Claude Mythos 5 | 36.0% | reported by Anthropic in the Claude Opus 5 system card | 8.12.1 |
| Chartography — With tools | Claude Mythos 5 | 85.2% | reported by Anthropic in the Claude Opus 5 system card | 8.12.1 |
| BenchCAD Vision2Code — No tools (1,000-file subset) | Claude Opus 5 | 0.366 | voxel IoU on a random 1,000-file subset of the 17,900 Vision2Code files; adaptive thinking at max effort; averaged over five runs; two documented harness corrections; developer-reported | 8.12.2 |
| BenchCAD Vision2Code — With tools (1,000-file subset) | Claude Opus 5 | 0.821 | container with image files, standard libraries and an image-cropping tool; developer-reported | 8.12.2 |
| BenchCAD Vision2Code — No tools (1,000-file subset) | Claude Opus 4.8 | 0.277 | reported by Anthropic in the Claude Opus 5 system card | 8.12.2 |
| BenchCAD Vision2Code — With tools (1,000-file subset) | Claude Opus 4.8 | 0.521 | reported by Anthropic in the Claude Opus 5 system card | 8.12.2 |
| BenchCAD Vision2Code — No tools (1,000-file subset) | Claude Mythos 5 | 0.378 | reported by Anthropic in the Claude Opus 5 system card | 8.12.2 |
| BenchCAD Vision2Code — With tools (1,000-file subset) | Claude Mythos 5 | 0.678 | reported by Anthropic in the Claude Opus 5 system card | 8.12.2 |
| GDP.pdf — No tools | Claude Opus 5 | 83.4% | mean criteria pass rate over the full 100 prompts, averaged over five runs; internal harness with base64 PDFs, Opus 4.7 as judge; harness truncation bug fixed and prior models re-run; developer-reported | 8.12.4 |
| GDP.pdf — With tools | Claude Opus 5 | 85.5% | container with the PDF, standard libraries and an image-cropping tool; developer-reported | 8.12.4 |
| GDP.pdf — No tools | Claude Opus 4.8 | 77.5% | reported by Anthropic in the Claude Opus 5 system card | 8.12.4 |
| GDP.pdf — With tools | Claude Opus 4.8 | 84.8% | reported by Anthropic in the Claude Opus 5 system card | 8.12.4 |
| GDP.pdf — No tools | Claude Mythos 5 | 81.8% | reported by Anthropic in the Claude Opus 5 system card | 8.12.4 |
| GDP.pdf — With tools | Claude Mythos 5 | 87.3% | reported by Anthropic in the Claude Opus 5 system card | 8.12.4 |
| OfficeQA — Full set | Claude Opus 5 | 78.1% | Databricks benchmark over U.S. Treasury Bulletin documents; agentic, extracted text in a sandbox with code execution; run on the public Messages API with production safeguards and fallback to Opus 4.8; developer-reported | 8.13.1 |
| OfficeQA — Pro (133-question subset) | Claude Opus 5 | 66.9% | as above; developer-reported | 8.13.1 |
| OfficeQA — Full set | Claude Opus 4.8 | 77.6% | evaluated on the internal API without production safeguards; reported by Anthropic in the Claude Opus 5 system card | 8.13.1 |
| OfficeQA — Pro (133-question subset) | Claude Opus 4.8 | 66.2% | as above | 8.13.1 |
| OfficeQA — Full set | Claude Mythos 5 | 79.0% | internal API without production safeguards; reported by Anthropic in the Claude Opus 5 system card | 8.13.1 |
| OfficeQA — Pro (133-question subset) | Claude Mythos 5 | 67.1% | as above | 8.13.1 |
| Legal Agent Benchmark (LAB) — All-pass rate (Anthropic harness) | Claude Opus 5 | 23.58% | ± 0.48, n=5; 1,235 of 1,251 problems (16 excluded for data defects); adaptive thinking at max effort; public Messages API with production safeguards and fallback to Opus 4.8; internal reimplementation exposing only bash and a Python tool; Claude Sonnet 4.6 as judge; developer-reported | 8.13.3 |
| Legal Agent Benchmark (LAB) — Mean criterion-pass rate (Anthropic harness) | Claude Opus 5 | 93.74% | as above; developer-reported | 8.13.3 |
| Legal Agent Benchmark (LAB) — All-pass rate (Harvey held-out set) | Claude Opus 5 | 11.7% | per Harvey's own evaluation on their held-out set | 8.13.3 |
| Legal Agent Benchmark (LAB) — Mean criterion-pass rate (Harvey held-out set) | Claude Opus 5 | 94.1% | per Harvey's own evaluation on their held-out set | 8.13.3 |
| AA-Briefcase — Elo | Claude Opus 5 | 1720 | long-horizon knowledge work; rubric scoring plus pairwise judging by a panel of frontier models; max effort; evaluation run independently by Artificial Analysis | 8.1; 8.13.5 |
| AA-Briefcase — Elo | Claude Opus 5 | 1693 | xhigh effort; 15% fewer output tokens than max; run by Artificial Analysis | 8.13.5 |
| AA-Briefcase — Elo | Claude Opus 5 | 1606 | high effort; 33% fewer output tokens than max; run by Artificial Analysis | 8.13.5 |
| AA-Briefcase — Elo | Claude Opus 4.8 | 1346 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| AA-Briefcase — Elo | Claude Fable 5 | 1574 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| AA-Briefcase — Elo | GPT-5.6 Sol | 1505 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| Toolathlon Verified — Pass@1 (internal harness) | Claude Opus 5 | 80.6 | 108 tasks, 3 trials; adaptive thinking at max effort, no safety classifiers or fallback; internal harness mirroring the authors' task definitions and checkers; developer-reported | 8.13.6 |
| Toolathlon Verified — Pass@3 (internal harness) | Claude Opus 5 | 87.0 | developer-reported | 8.13.6 |
| Toolathlon Verified — Pass³ (internal harness) | Claude Opus 5 | 73.1 | developer-reported | 8.13.6 |
| Toolathlon Verified — Average assistant turns (internal harness) | Claude Opus 5 | 23.5 | developer-reported | 8.13.6 |
| Toolathlon Verified — Pass@1 (internal harness) | Claude Mythos 5 | 79.3 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@3 (internal harness) | Claude Mythos 5 | 86.1 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass³ (internal harness) | Claude Mythos 5 | 73.1 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Average assistant turns (internal harness) | Claude Mythos 5 | 19.8 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@1 (internal harness) | Claude Opus 4.8 | 79.9 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@3 (internal harness) | Claude Opus 4.8 | 88.0 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass³ (internal harness) | Claude Opus 4.8 | 71.3 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Average assistant turns (internal harness) | Claude Opus 4.8 | 20.4 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@1 (internal harness) | Claude Sonnet 5 | 74.7 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@3 (internal harness) | Claude Sonnet 5 | 84.3 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass³ (internal harness) | Claude Sonnet 5 | 65.7 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Average assistant turns (internal harness) | Claude Sonnet 5 | 24.5 | reported by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@1 (published leaderboard) | Claude Sonnet 5 | 71.6% | authors' published leaderboard, which counts 8 of 324 null attempts as failures; cited by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| Toolathlon Verified — Pass@1 (published leaderboard) | Claude Opus 4.8 | 76.2% | authors' published leaderboard, 11 null attempts counted as failures; cited by Anthropic in the Claude Opus 5 system card | 8.13.6 |
| AutomationBench — Private held-out leaderboard | Claude Opus 5 | 26.0% | Zapier benchmark, simulated company with REST APIs across 47 apps; max effort; developer-reported | 8.1; 8.13.7 |
| AutomationBench — Private held-out leaderboard | Claude Opus 5 | 24% | medium effort, at $0.89 cost per task; developer-reported | 8.13.7 |
| AutomationBench — Private held-out leaderboard | Claude Opus 4.8 | 17.0% | max effort; reported by Anthropic in the Claude Opus 5 system card | 8.1; 8.13.7 |
| AutomationBench — Private held-out leaderboard | Claude Fable 5 | 17.4% | reported by Anthropic in the Claude Opus 5 system card | 8.1; 8.13.7 |
| AutomationBench — Private held-out leaderboard | GPT-5.6 Sol | 18.1 | reported by Anthropic in the Claude Opus 5 system card (Table 8.1.A) | 8.1 |
| MILU | Claude Opus 5 | 92.1% | 11 languages (10 Indic plus English); max effort; averaged over 5 trials; value read from Figure 8.16.2.A in label order; developer-reported | 8.16.2 |
| MILU | Claude Sonnet 5 | 89.3% | value read from Figure 8.16.2.A in label order | 8.16.2 |
| MILU | Claude Mythos 5 | 92.9% | value read from Figure 8.16.2.A in label order | 8.16.2 |
| MILU | Claude Opus 4.8 | 91.1% | value read from Figure 8.16.2.A in label order | 8.16.2 |
| MILU | Claude Mythos Preview | 92.7% | value read from Figure 8.16.2.A in label order | 8.16.2 |
| INCLUDE | Claude Opus 5 | 89.8% | 44 languages; max effort; averaged over 5 trials; value read from Figure 8.16.3.A in label order; developer-reported | 8.16.3 |
| INCLUDE | Claude Sonnet 5 | 86.5% | value read from Figure 8.16.3.A in label order | 8.16.3 |
| INCLUDE | Claude Mythos 5 | 90.5% | value read from Figure 8.16.3.A in label order | 8.16.3 |
| INCLUDE | Claude Opus 4.8 | 88.5% | value read from Figure 8.16.3.A in label order | 8.16.3 |
| INCLUDE | Claude Mythos Preview | 90.1% | value read from Figure 8.16.3.A in label order | 8.16.3 |
| BioMysteryBench — Human solvable | Claude Opus 5 | 90.1% | bash tool, file editor and package managers available; 3 problems removed from the human-solvable set on external feedback; developer-reported | 8.17.1 |
| BioMysteryBench — Human difficult | Claude Opus 5 | 49.4% | 6 problems removed from the human-difficult set on external feedback; developer-reported | 8.17.1 |
| BioMysteryBench — Human solvable | Claude Mythos 5 | 89.0% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| BioMysteryBench — Human difficult | Claude Mythos 5 | 46.5% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| BioMysteryBench — Human solvable | Claude Opus 4.8 | 88.5% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| BioMysteryBench — Human difficult | Claude Opus 4.8 | 42.4% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| BioMysteryBench — Human solvable | Claude Sonnet 5 | 87.5% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| BioMysteryBench — Human difficult | Claude Sonnet 5 | 34.1% | reported by Anthropic in the Claude Opus 5 system card | 8.17.1 |
| LatchBio SpatialBench Verified | Claude Opus 5 | 72.5% | 115 externally validated spatial-transcriptomics problems; bash, file editor and package managers; developer-reported | 8.17.2 |
| LatchBio SpatialBench Verified | Claude Mythos 5 | 69.2% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| LatchBio SpatialBench Verified | Claude Sonnet 5 | 67.8% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| LatchBio SpatialBench Verified | Claude Opus 4.8 | 66.6% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| LatchBio SingleCellBench | Claude Opus 5 | 60.6% | 195 single-cell RNA-sequencing problems; developer-reported | 8.17.2 |
| LatchBio SingleCellBench | Claude Mythos 5 | 59.3% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| LatchBio SingleCellBench | Claude Opus 4.8 | 58.2% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| LatchBio SingleCellBench | Claude Sonnet 5 | 56.2% | reported by Anthropic in the Claude Opus 5 system card | 8.17.2 |
| ProteinGym Hard | Claude Opus 5 | 47.7% | rank correlation against published lab measurements; bash and file editor, no package managers; developer-reported | 8.17.3 |
| ProteinGym Hard | Claude Mythos 5 | 45.8% | reported by Anthropic in the Claude Opus 5 system card | 8.17.3 |
| ProteinGym Hard | Claude Opus 4.8 | 40.0% | reported by Anthropic in the Claude Opus 5 system card | 8.17.3 |
| ProteinGym Hard | Claude Sonnet 5 | 36.6% | reported by Anthropic in the Claude Opus 5 system card | 8.17.3 |
| Protein Design | Claude Opus 5 | 42.5% | scored by constraint satisfaction, folding confidence and sequence novelty; no tool access; developer-reported | 8.17.4 |
| Protein Design | Claude Mythos 5 | 41.4% | reported by Anthropic in the Claude Opus 5 system card | 8.17.4 |
| Protein Design | Claude Opus 4.8 | 32.0% | reported by Anthropic in the Claude Opus 5 system card | 8.17.4 |
| Protein Design | Claude Sonnet 5 | 21.2% | reported by Anthropic in the Claude Opus 5 system card | 8.17.4 |
| Organic chemistry, V2 | Claude Opus 5 | 61.6% | updated with harder expert-recommended problems; 10 of 1,260 attempts timed out and were excluded (≤±0.006 effect); developer-reported | 8.17.5 |
| Organic chemistry, V2 | Claude Mythos 5 | 58.9% | reported by Anthropic in the Claude Opus 5 system card | 8.17.5 |
| Organic chemistry, V2 | Claude Opus 4.8 | 50.4% | reported by Anthropic in the Claude Opus 5 system card | 8.17.5 |
| Organic chemistry, V2 | Claude Sonnet 5 | 40.6% | reported by Anthropic in the Claude Opus 5 system card | 8.17.5 |
| Protocols — Troubleshooting | Claude Opus 5 | 61.1% | bash, file editor and web search available; developer-reported | 8.17.6 |
| Protocols — Troubleshooting | Claude Mythos 5 | 66.7% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
| Protocols — Troubleshooting | Claude Sonnet 5 | 62.3% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
| Protocols — Troubleshooting | Claude Opus 4.8 | 59.6% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
| Protocols — Understanding (Benchling) | Claude Opus 5 | 78.4% | variant created by Benchling; developer-reported | 8.17.6 |
| Protocols — Understanding (Benchling) | Claude Mythos 5 | 68.1% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
| Protocols — Understanding (Benchling) | Claude Opus 4.8 | 62.3% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
| Protocols — Understanding (Benchling) | Claude Sonnet 5 | 60.5% | reported by Anthropic in the Claude Opus 5 system card | 8.17.6 |
Discrepancies noted
Table 5.2.2.3.A gives Claude Opus 5's browser-use attack success rate with thinking as 3.84% (11 of 129 attempts); the prose beneath it says the mitigations reduced the rate "from 11.15% to 3.70%". Table 8.1.A prints Mythos 5's HealthBench Professional score (66.011) in the Claude Fable 5 column; footnote 11 and figure 8.15.2.A attribute it to Mythos 5. The OSS-Fuzz figure's data labels (61.5 / 80.0 / 79.4 / 54.5) do not match the prose, which gives Opus 5 79.4% and Opus 4.8 38.5%; the prose figures are recorded above.
Provenance
Scraped from the Anthropic-hosted system card page at anthropic.com on September 19, 2026, including the August 19, 2026 changelog and the appendix (the Humanity's Last Exam and BrowseComp blocklists and the SWE-bench Multimodal test harness modifications). Figures are not reproduced in the capture; chart values appear as loose numbers beside their series labels, so some per-model figures in the card are not recoverable from the text.
Relationships
- supports: Claude Opus 5 — the safety documentation for the release
- related: Responsible Scaling Policy (RSP) — the framework under which the determinations are made
- related: System Card: Claude Opus 4.8 (Anthropic, May 2026), Claude Opus 4.8, Claude Mythos 5, Claude Fable 5, Claude Sonnet 5 — the comparison models throughout the card
- related: CBRN Uplift, AI Biosecurity, AI and Cybersecurity, Prompt Injection, UK AI Safety Institute (AI Security Institute), Anthropic