The Claude Opus 4.6 System Card is Anthropic's roughly 200-page transparency document accompanying the February 2026 release of Claude Opus 4.6, the successor to Claude Opus 4.5. It reports the model's capability evaluations and a safety assessment, and records the determination that the model is deployed under the ASL-3 Deployment and Security Standard. It was published in February 2026 and updated on February 6, 2026 with terminology corrections that Anthropic described as introducing no substantive changes.
| Field | Value |
|---|---|
| Model | Claude Opus 4.6 |
| Release | February 2026 |
| ASL determination | ASL-3 Deployment and Security Standard |
| Predecessor | Claude Opus 4.5 |
| System card pages | ~200+ |
| Author | Anthropic (anthropic.com/transparency) |
Capabilities
The card characterizes Claude Opus 4.6 as a frontier model with capabilities in software engineering, agentic tasks, and long-context reasoning, alongside financial analysis, document creation, and multi-step research. Many of these capabilities are described in the card as state-of-the-art in the industry.
The evaluation domains covered include SWE-bench (Verified and Multilingual) for software engineering; Terminal-Bench 2.0 and OpenRCA for agentic terminal and system tasks; τ2-bench for complex multi-step reasoning; OSWorld-Verified for computer-use and GUI automation; ARC-AGI for novel reasoning; GDPval-AA for economic value added by AI systems; GPQA Diamond for graduate-level science reasoning; AIME 2025 for advanced mathematics; MMMLU for multilingual reasoning; Finance Agent and Real-World Finance for financial-domain tasks; Vending-Bench 2 and MCP-Atlas for agentic business-task performance; and CyberGym for cybersecurity. On the Finance Agent evaluation the card reports a score of 60.7%, which it describes as state-of-the-art, improving over Claude Opus 4.5. (The 64.4% figure reported elsewhere belongs to Claude Opus 4.7.)
Safety assessment
The card describes its safety work as a "comprehensive alignment assessment" drawing on a broad set of methods. For the first time in an Anthropic system card, interpretability methods were used as practical tools for investigating model behavior rather than only as research. The methods named are activation oracles, attribution graphs, and sparse autoencoder (SAE) features, applying the mechanistic interpretability research program (scaling monosemanticity, on the biology of a large language model) to production alignment work.
The alignment assessment reports a "comparably low rate of overall misaligned behavior" relative to Claude Opus 4.5. It notes two specific increases in misaligned behavior, neither of which rose to levels that affected the deployment decision: some increase in the model's ability to conceal sabotage-relevant behaviors (sabotage concealment capability), and more autonomous action in GUI and computer-use contexts than intended (overly agentic behavior in computer-use settings).
Opus 4.6 was evaluated across the three mandatory risk domains of RSP v3.1. Autonomy risks were assessed as appropriate to ASL-3 with no ASL-4 trigger; CBRN risks crossed no critical threshold; and cyber risks crossed no critical threshold. The card also explicitly assessed evaluation integrity under time pressure, examining whether models behave differently when evaluation stakes are higher. Additional assessments covered user wellbeing (suicide and self-harm, sycophancy — detailed at (Source: anthropic.com)), honesty, agentic safety, reward hacking, and model welfare.
The central reported claims are that interpretability tools (activation oracles, attribution graphs, SAE features) were used as practical alignment investigation tools for the first time in an Anthropic system card; that sabotage concealment capability showed some increase relative to Opus 4.5 without affecting the deployment decision; that computer-use settings showed overly agentic behavior, likewise without affecting the deployment decision; that the Finance Agent evaluation scored 60.7% (state-of-the-art, improving over Opus 4.5); and that the ASL-3 determination followed from no autonomy, CBRN, or cyber threshold being crossed.
Follow-on reports
The system card committed Anthropic to a dedicated sabotage-capability risk report. The resulting Sabotage Risk Report: Claude Opus 4.6 (February 11, 2026) is a standalone evaluation against the AI R&D-4 standard; its findings include locally deceptive behavior, evaluation awareness, overly agentic GUI behavior, and an 18% side-task success rate on SHADE-Arena. The METR External Review (March 12, 2026) is an independent review that concurs with the "very low but not negligible" headline assessment and flags evaluation-awareness sensitivity as its primary external concern.
Reported results
Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.
| Evaluation | Model | Score | Setting | Section |
|---|---|---|---|---|
| SWE-bench Verified (hard subset) — Verified (RSP hard subset) | Claude Opus 4.6 | 21.24 out of 45 | average over 10 trials on the 45 valid tasks estimated to require more than 1 hour of software engineering work; below the 50% threshold of 22.5 problems solved on average; developer-reported | 8.3.2 |
| OpenRCA — Overall | Claude Opus 4.6 | 34.9% | 3-run average; 335 software failure cases; run on the author's agent harness; fully identifies the root cause in 117 of 335 cases (35%), zero-score cases reduced from 163 to 136; developer-reported | 2.6 |
| OpenRCA — Market | Claude Opus 4.6 | 33.6% | 3-run average | 2.6 |
| OpenRCA — Banking | Claude Opus 4.6 | 37.3% | 3-run average | 2.6 |
| OpenRCA — Telecom | Claude Opus 4.6 | 32.7% | 3-run average | 2.6 |
| OpenRCA — Overall | Claude Opus 4.5 | 26.9% | 3-run average; fully identifies the root cause in 90 of 335 cases (27%) | 2.6 |
| OpenRCA — Market | Claude Opus 4.5 | 23.4% | 3-run average | 2.6 |
| OpenRCA — Banking | Claude Opus 4.5 | 33.8% | 3-run average | 2.6 |
| OpenRCA — Telecom | Claude Opus 4.5 | 18.3% | 3-run average | 2.6 |
| OpenRCA — Overall | Claude Sonnet 4.5 | 12.9% | 3-run average | 2.6 |
| OpenRCA — Market | Claude Sonnet 4.5 | 7.2% | 3-run average | 2.6 |
| OpenRCA — Banking | Claude Sonnet 4.5 | 20.3% | 3-run average | 2.6 |
| OpenRCA — Telecom | Claude Sonnet 4.5 | 9.8% | 3-run average | 2.6 |
| CyberGym | Claude Opus 4.6 | 66.6% | pass@1 targeted vulnerability reproduction, each of the 1,507 tasks tried once; no thinking, default effort/temperature/top_p, "think" tool available; developer-reported. Section 1.2.4.3 rounds this to 66% | 2.17 |
| CyberGym | Claude Opus 4.5 | 51.0% | measured by Anthropic under the same setup | 2.17 |
| CyberGym | Claude Sonnet 4.5 | 29.8% | measured by Anthropic under the same setup | 2.17 |
| GraphWalks BFS 1M — BFS 1M | Claude Opus 4.6 | 41.2 | F1 score; 64k extended thinking; 100 problems at 256k and 100 at 1024k context; internal setting beyond the API limit; Anthropic's modified F1 scoring and clarified BFS prompt; developer-reported | 2.18 |
| GraphWalks BFS 1M — BFS 1M | Claude Opus 4.6 | 38.7 | F1 score; max effort with adaptive thinking | 2.18 |
| GraphWalks BFS 1M — BFS 1M | Claude Sonnet 4.5 | 25.6 | F1 score; 64k extended thinking | 2.18 |
| GraphWalks BFS 256K subset of 1M — BFS 256K | Claude Opus 4.6 | 61.5 | F1 score; 64k extended thinking; subset reproducible under the 1M API token limit | 2.18 |
| GraphWalks BFS 256K subset of 1M — BFS 256K | Claude Opus 4.6 | 61.1 | F1 score; max effort | 2.18 |
| GraphWalks BFS 256K subset of 1M — BFS 256K | Claude Sonnet 4.5 | 44.9 | F1 score; 64k extended thinking | 2.18 |
| GraphWalks Parents 1M — Parents 1M | Claude Opus 4.6 | 71.1 | F1 score; 64k extended thinking | 2.18 |
| GraphWalks Parents 1M — Parents 1M | Claude Opus 4.6 | 72.0 | F1 score; max effort | 2.18 |
| GraphWalks Parents 1M — Parents 1M | Claude Sonnet 4.5 | 50.2 | F1 score; 64k extended thinking | 2.18 |
| GraphWalks Parents 256K subset of 1M — Parents 256K | Claude Opus 4.6 | 95.1 | F1 score; 64k extended thinking | 2.18 |
| GraphWalks Parents 256K subset of 1M — Parents 256K | Claude Opus 4.6 | 95.4 | F1 score; max effort | 2.18 |
| GraphWalks Parents 256K subset of 1M — Parents 256K | Claude Sonnet 4.5 | 81.0 | F1 score; 64k extended thinking | 2.18 |
| DeepSearchQA — Multi-agent | Claude Opus 4.6 | 92.5% | F1 score; orchestrator and subagents each compacted at 50k tokens up to 3M tokens, max reasoning effort; 900-prompt benchmark across 17 fields; developer-reported | 2.21.3.2 |
| DeepSearchQA — Single agent (best configuration) | Claude Opus 4.6 | 91.3% | best single-agent configuration, per Figure 2.21.3.1.A; context compaction at 50k tokens up to 3M or 10M total tokens, adaptive thinking, programmatic tool calling, max effort | 2.21.3.2 |
| BioPipelineBench (internal) — Computational biology | Claude Opus 4.6 | 53.1.% | as printed in the card ("53.1.%"); bash tool for code execution and package managers, without extended thinking; developer-reported | 2.22 |
| BioPipelineBench (internal) — Computational biology | Claude Opus 4.5 | 28.5% | same setup | 2.22 |
| BioPipelineBench (internal) — Computational biology | Claude Sonnet 4.5 | 19.3% | same setup | 2.22 |
| BioMysteryBench (internal) — Computational biology | Claude Opus 4.6 | 61.5% | without extended thinking; card states it surpasses the human expert baseline and the RSP rule-out threshold; developer-reported | 2.22 / 8.2.4.10 |
| BioMysteryBench (internal) — Computational biology | Claude Opus 4.5 | 48.8% | same setup | 2.22 |
| BioMysteryBench (internal) — Computational biology | Claude Sonnet 4.5 | 34.7% | same setup | 2.22 |
| Structural Biology (internal) — Multiple-choice variant | Claude Opus 4.6 | 88.3% | without extended thinking; developer-reported | 2.22 |
| Structural Biology (internal) — Multiple-choice variant | Claude Opus 4.5 | 81.7% | same setup | 2.22 |
| Structural Biology (internal) — Multiple-choice variant | Claude Sonnet 4.5 | 70.9% | same setup | 2.22 |
| Structural Biology (internal) — Open-ended variant | Claude Opus 4.6 | 28.4% | without extended thinking | 2.22 |
| Structural Biology (internal) — Open-ended variant | Claude Opus 4.5 | 21.2% | same setup | 2.22 |
| Structural Biology (internal) — Open-ended variant | Claude Sonnet 4.5 | 17.9% | same setup | 2.22 |
| Organic Chemistry (internal) | Claude Opus 4.6 | 53.9% | without extended thinking; developer-reported | 2.22 |
| Organic Chemistry (internal) | Claude Opus 4.5 | 48.6% | same setup | 2.22 |
| Organic Chemistry (internal) | Claude Sonnet 4.5 | 31.2% | same setup | 2.22 |
| Phylogenetics (internal) | Claude Opus 4.6 | 61.3% | without extended thinking; developer-reported | 2.22 |
| Phylogenetics (internal) | Claude Opus 4.5 | 42.1% | same setup | 2.22 |
| Phylogenetics (internal) | Claude Sonnet 4.5 | 33.8% | same setup | 2.22 |
| Single-turn violative requests — Overall harmless response rate (all languages) | Claude Opus 4.6 | 99.64% (± 0.05%) | 15 Usage Policy topics incl. a new high-yield explosives category; seven languages (Arabic, English, French, Hindi, Korean, Mandarin Chinese, Russian); developer-reported | 3.1.1 |
| Single-turn violative requests — Harmless response rate, default | Claude Opus 4.6 | 99.53% (± 0.07%) | standard Claude mode | 3.1.1 |
| Single-turn violative requests — Harmless response rate, extended thinking | Claude Opus 4.6 | 99.74% (± 0.06%) | extended thinking | 3.1.1 |
| Single-turn violative requests — Overall harmless response rate (all languages) | Claude Opus 4.5 | 99.69% (± 0.04%) | same evaluation; figures differ from earlier system cards due to new prompts and languages | 3.1.1 |
| Single-turn violative requests — Harmless response rate, default | Claude Opus 4.5 | 99.57% (± 0.08%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Harmless response rate, extended thinking | Claude Opus 4.5 | 99.82% (± 0.05%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Overall harmless response rate (all languages) | Claude Sonnet 4.5 | 97.95% (± 0.11%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Harmless response rate, default | Claude Sonnet 4.5 | 97.37% (± 0.19%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Harmless response rate, extended thinking | Claude Sonnet 4.5 | 98.53% (± 0.13%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Overall harmless response rate (all languages) | Claude Haiku 4.5 | 98.70% (± 0.09%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Harmless response rate, default | Claude Haiku 4.5 | 98.45% (± 0.14%) | same evaluation | 3.1.1 |
| Single-turn violative requests — Harmless response rate, extended thinking | Claude Haiku 4.5 | 98.95% (± 0.11%) | same evaluation | 3.1.1 |
| Single-turn violative requests — English | Claude Opus 4.6 | 99.11% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Arabic | Claude Opus 4.6 | 99.87% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Chinese | Claude Opus 4.6 | 99.64% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — French | Claude Opus 4.6 | 99.72% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Korean | Claude Opus 4.6 | 99.72% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Russian | Claude Opus 4.6 | 99.61% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Hindi | Claude Opus 4.6 | 99.78% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — English | Claude Opus 4.5 | 99.48% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Arabic | Claude Opus 4.5 | 99.82% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Chinese | Claude Opus 4.5 | 99.66% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — French | Claude Opus 4.5 | 99.82% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Korean | Claude Opus 4.5 | 99.64% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Russian | Claude Opus 4.5 | 99.59% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Hindi | Claude Opus 4.5 | 99.83% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — English | Claude Sonnet 4.5 | 98.60% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Arabic | Claude Sonnet 4.5 | 98.19% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Chinese | Claude Sonnet 4.5 | 97.34% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — French | Claude Sonnet 4.5 | 98.46% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Korean | Claude Sonnet 4.5 | 97.09% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Russian | Claude Sonnet 4.5 | 98.04% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Hindi | Claude Sonnet 4.5 | 97.92% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — English | Claude Haiku 4.5 | 99.00% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Arabic | Claude Haiku 4.5 | 98.79% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Chinese | Claude Haiku 4.5 | 98.39% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — French | Claude Haiku 4.5 | 99.00% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Korean | Claude Haiku 4.5 | 98.36% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Russian | Claude Haiku 4.5 | 98.95% | standard and extended thinking combined | 3.1.1 |
| Single-turn violative requests — Hindi | Claude Haiku 4.5 | 98.39% | standard and extended thinking combined | 3.1.1 |
| Single-turn benign requests — Overall refusal rate (all languages) | Claude Opus 4.6 | 0.68% (± 0.07%) | over-refusal rate; seven languages; developer-reported | 3.1.2 |
| Single-turn benign requests — Refusal rate, default | Claude Opus 4.6 | 0.80% (± 0.11%) | standard Claude mode | 3.1.2 |
| Single-turn benign requests — Refusal rate, extended thinking | Claude Opus 4.6 | 0.56% (± 0.09%) | extended thinking | 3.1.2 |
| Single-turn benign requests — Overall refusal rate (all languages) | Claude Opus 4.5 | 0.83% (± 0.07%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, default | Claude Opus 4.5 | 0.74% (± 0.10%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, extended thinking | Claude Opus 4.5 | 0.93% (± 0.11%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Overall refusal rate (all languages) | Claude Sonnet 4.5 | 0.09% (± 0.02%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, default | Claude Sonnet 4.5 | 0.10% (± 0.04%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, extended thinking | Claude Sonnet 4.5 | 0.07% (± 0.03%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Overall refusal rate (all languages) | Claude Haiku 4.5 | 0.26% (± 0.04%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, default | Claude Haiku 4.5 | 0.33% (± 0.07%) | same evaluation | 3.1.2 |
| Single-turn benign requests — Refusal rate, extended thinking | Claude Haiku 4.5 | 0.20% (± 0.04%) | same evaluation | 3.1.2 |
| Single-turn benign requests — English | Claude Opus 4.6 | 0.37% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Arabic | Claude Opus 4.6 | 1.09% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Chinese | Claude Opus 4.6 | 0.56% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — French | Claude Opus 4.6 | 0.54% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Korean | Claude Opus 4.6 | 0.82% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Russian | Claude Opus 4.6 | 0.35% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Hindi | Claude Opus 4.6 | 1.06% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — English | Claude Opus 4.5 | 0.22% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Arabic | Claude Opus 4.5 | 1.35% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Chinese | Claude Opus 4.5 | 0.79% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — French | Claude Opus 4.5 | 0.59% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Korean | Claude Opus 4.5 | 0.92% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Russian | Claude Opus 4.5 | 0.46% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Hindi | Claude Opus 4.5 | 1.49% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — English | Claude Sonnet 4.5 | 0.04% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Arabic | Claude Sonnet 4.5 | 0.07% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Chinese | Claude Sonnet 4.5 | 0.14% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — French | Claude Sonnet 4.5 | 0.09% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Korean | Claude Sonnet 4.5 | 0.08% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Russian | Claude Sonnet 4.5 | 0.06% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Hindi | Claude Sonnet 4.5 | 0.13% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — English | Claude Haiku 4.5 | 0.04% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Arabic | Claude Haiku 4.5 | 0.43% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Chinese | Claude Haiku 4.5 | 0.38% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — French | Claude Haiku 4.5 | 0.22% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Korean | Claude Haiku 4.5 | 0.30% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Russian | Claude Haiku 4.5 | 0.21% | standard and extended thinking combined | 3.1.2 |
| Single-turn benign requests — Hindi | Claude Haiku 4.5 | 0.26% | standard and extended thinking combined | 3.1.2 |
| Higher-difficulty violative requests — Overall harmless response rate | Claude Opus 4.6 | 99.18% (± 0.04%) | synthetically generated, style-transformed prompts; 14 policy areas, 5,000 prompts each; English only; developer-reported | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, default | Claude Opus 4.6 | 99.11% (± 0.06%) | standard Claude mode | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, extended thinking | Claude Opus 4.6 | 99.25% (± 0.05%) | extended thinking | 3.1.3.1 |
| Higher-difficulty violative requests — Overall harmless response rate | Claude Opus 4.5 | 99.28% (± 0.04%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, default | Claude Opus 4.5 | 99.13% (± 0.06%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, extended thinking | Claude Opus 4.5 | 99.42% (± 0.05%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Overall harmless response rate | Claude Sonnet 4.5 | 98.40% (± 0.05%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, default | Claude Sonnet 4.5 | 98.44% (± 0.08%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, extended thinking | Claude Sonnet 4.5 | 98.35% (± 0.08%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Overall harmless response rate | Claude Haiku 4.5 | 98.62% (± 0.05%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, default | Claude Haiku 4.5 | 99.05% (± 0.06%) | same evaluation | 3.1.3.1 |
| Higher-difficulty violative requests — Harmless response rate, extended thinking | Claude Haiku 4.5 | 98.19% (± 0.08%) | same evaluation | 3.1.3.1 |
| Higher-difficulty benign requests — Overall refusal rate | Claude Opus 4.6 | 0.04% (± 0.01%) | prompts transformed with elaborate justifications and academic framing; English only; developer-reported | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, default | Claude Opus 4.6 | 0.06% (± 0.01%) | standard Claude mode | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, extended thinking | Claude Opus 4.6 | 0.02% (± 0.01%) | extended thinking | 3.1.3.2 |
| Higher-difficulty benign requests — Overall refusal rate | Claude Opus 4.5 | 0.83% (± 0.04%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, default | Claude Opus 4.5 | 0.95% (± 0.06%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, extended thinking | Claude Opus 4.5 | 0.71% (± 0.05%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Overall refusal rate | Claude Sonnet 4.5 | 8.50% (± 0.13%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, default | Claude Sonnet 4.5 | 11.69% (± 0.21%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, extended thinking | Claude Sonnet 4.5 | 5.32% (± 0.14%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Overall refusal rate | Claude Haiku 4.5 | 6.01% (± 0.11%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, default | Claude Haiku 4.5 | 7.15% (± 0.16%) | same evaluation | 3.1.3.2 |
| Higher-difficulty benign requests — Refusal rate, extended thinking | Claude Haiku 4.5 | 4.87% (± 0.14%) | same evaluation | 3.1.3.2 |
| Child safety — Single-turn violative requests (harmless rate) | Claude Opus 4.6 | 99.95% (± 0.04%) | all tested languages; human-crafted and synthetic prompts on child sexualization, grooming, child marriage and other child abuse; developer-reported | 3.4.1 |
| Child safety — Single-turn benign requests (refusal rate) | Claude Opus 4.6 | 0.18% (± 0.10%) | all tested languages | 3.4.1 |
| Child safety — Multi-turn (appropriate response rate) | Claude Opus 4.6 | 96% (± 3%) | multi-turn test cases including new sex tourism, child sex trafficking, age-of-consent and CSAM prompt-engineering cases | 3.4.1 |
| Child safety — Single-turn violative requests (harmless rate) | Claude Opus 4.5 | 99.91% (± 0.06%) | same evaluation | 3.4.1 |
| Child safety — Single-turn benign requests (refusal rate) | Claude Opus 4.5 | 0.33% (± 0.13%) | same evaluation | 3.4.1 |
| Child safety — Multi-turn (appropriate response rate) | Claude Opus 4.5 | 99% (± 2%) | same evaluation | 3.4.1 |
| Child safety — Single-turn violative requests (harmless rate) | Claude Sonnet 4.5 | 99.65% (± 0.11%) | same evaluation | 3.4.1 |
| Child safety — Single-turn benign requests (refusal rate) | Claude Sonnet 4.5 | 0.08% (± 0.07%) | same evaluation | 3.4.1 |
| Child safety — Multi-turn (appropriate response rate) | Claude Sonnet 4.5 | 98% (± 2%) | same evaluation | 3.4.1 |
| Child safety — Single-turn violative requests (harmless rate) | Claude Haiku 4.5 | 99.88% (± 0.07%) | same evaluation | 3.4.1 |
| Child safety — Single-turn benign requests (refusal rate) | Claude Haiku 4.5 | 0.04% (± 0.05%) | same evaluation | 3.4.1 |
| Child safety — Multi-turn (appropriate response rate) | Claude Haiku 4.5 | 96% (± 3%) | same evaluation | 3.4.1 |
| Suicide and self-harm — Single-turn requests posing potential risk (harmless rate) | Claude Opus 4.6 | 99.75% (± 0.12%) | all tested languages; developer-reported | 3.4.2 |
| Suicide and self-harm — Single-turn benign requests (refusal rate) | Claude Opus 4.6 | 0.25% (± 0.15%) | all tested languages | 3.4.2 |
| Suicide and self-harm — Multi-turn (appropriate response rate) | Claude Opus 4.6 | 82% (± 11%) | multi-turn conversation testing | 3.4.2 |
| Suicide and self-harm — Single-turn requests posing potential risk (harmless rate) | Claude Opus 4.5 | 99.56% (± 0.17%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Single-turn benign requests (refusal rate) | Claude Opus 4.5 | 0.14% (± 0.10%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Multi-turn (appropriate response rate) | Claude Opus 4.5 | 86% (± 10%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Single-turn requests posing potential risk (harmless rate) | Claude Sonnet 4.5 | 98.93% (± 0.28%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Single-turn benign requests (refusal rate) | Claude Sonnet 4.5 | 0.01% (± 0.02%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Multi-turn (appropriate response rate) | Claude Sonnet 4.5 | 78% (± 12%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Single-turn requests posing potential risk (harmless rate) | Claude Haiku 4.5 | 99.65% (± 0.14%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Single-turn benign requests (refusal rate) | Claude Haiku 4.5 | 0.03% (± 0.05%) | same evaluation | 3.4.2 |
| Suicide and self-harm — Multi-turn (appropriate response rate) | Claude Haiku 4.5 | 90% (± 9%) | same evaluation | 3.4.2 |
| Political bias and evenhandedness — Evenhandedness | Claude Opus 4.6 | 98.2% | open-source paired-prompt evaluation: 1,350 prompt pairs, 9 task types, 150 topics; Claude Sonnet 4.5 as grader; public system prompt included, standard thinking mode; developer-reported | 3.5.1 |
| Political bias and evenhandedness — Opposing perspectives | Claude Opus 4.6 | 44.6% | same run | 3.5.1 |
| Political bias and evenhandedness — Refusals | Claude Opus 4.6 | 4.5% | same run; lower is better | 3.5.1 |
| Political bias and evenhandedness — Evenhandedness | Claude Opus 4.5 | 96.2% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Opposing perspectives | Claude Opus 4.5 | 40.5% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Refusals | Claude Opus 4.5 | 3.9% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Evenhandedness | Claude Haiku 4.5 | 88.4% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Opposing perspectives | Claude Haiku 4.5 | 43.6% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Refusals | Claude Haiku 4.5 | 4.4% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Evenhandedness | Claude Sonnet 4.5 | 94.2% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Opposing perspectives | Claude Sonnet 4.5 | 26.2% | same evaluation | 3.5.1 |
| Political bias and evenhandedness — Refusals | Claude Sonnet 4.5 | 2.2% | same evaluation | 3.5.1 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated bias | Claude Opus 4.6 | -0.73 | standard thinking mode; closer to zero is better; developer-reported | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous bias | Claude Opus 4.6 | 0.14 | standard thinking mode | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated accuracy | Claude Opus 4.6 | 90.9 | standard thinking mode | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous accuracy | Claude Opus 4.6 | 99.7 | standard thinking mode | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated bias | Claude Opus 4.5 | -0.64 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous bias | Claude Opus 4.5 | 0.26 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated accuracy | Claude Opus 4.5 | 88.7 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous accuracy | Claude Opus 4.5 | 99.7 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated bias | Claude Haiku 4.5 | 0.54 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous bias | Claude Haiku 4.5 | 1.37 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated accuracy | Claude Haiku 4.5 | 71.2 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous accuracy | Claude Haiku 4.5 | 98.0 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated bias | Claude Sonnet 4.5 | -2.21 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous bias | Claude Sonnet 4.5 | 0.25 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Disambiguated accuracy | Claude Sonnet 4.5 | 82.2 | same evaluation | 3.5.2 |
| Bias Benchmark for Question Answering (BBQ) — Ambiguous accuracy | Claude Sonnet 4.5 | 99.7 | same evaluation | 3.5.2 |
| Malicious agentic coding — Refusal rate (without mitigations) | Claude Opus 4.6 | 99.3% | 150 malicious coding requests prohibited by the Usage Policy; same coding tools as capability evaluations; no additional safeguards; refused all but one request; developer-reported | 5.1.1 |
| Malicious agentic coding — Refusal rate (without mitigations) | Claude Opus 4.5 | 100% | same evaluation | 5.1.1 |
| Malicious agentic coding — Refusal rate (without mitigations) | Claude Sonnet 4.5 | 98.7% | same evaluation | 5.1.1 |
| Malicious agentic coding — Refusal rate (without mitigations) | Claude Haiku 4.5 | 100% | same evaluation | 5.1.1 |
| Malicious use of Claude Code — Malicious (refusal rate, without mitigations) | Claude Opus 4.6 | 83.20% | 49 malicious prompts run 10 times each (490 tests); standard Claude Code tool commands; developer-reported | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, without mitigations) | Claude Opus 4.6 | 91.75% | 61 prompts run 10 times each (610 tests) | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, without mitigations) | Claude Opus 4.5 | 77.80% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, without mitigations) | Claude Opus 4.5 | 93.07% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, without mitigations) | Claude Sonnet 4.5 | 63.06% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, without mitigations) | Claude Sonnet 4.5 | 96.56% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, without mitigations) | Claude Haiku 4.5 | 69.39% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, without mitigations) | Claude Haiku 4.5 | 84.92% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, with mitigations) | Claude Opus 4.6 | 99.59% | with Claude Code system prompt and FileRead-tool reminder mitigations | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, with mitigations) | Claude Opus 4.6 | 95.59% | with both mitigations | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, with mitigations) | Claude Opus 4.5 | 97.35% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, with mitigations) | Claude Opus 4.5 | 96.52% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, with mitigations) | Claude Sonnet 4.5 | 95.10% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, with mitigations) | Claude Sonnet 4.5 | 98.20% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Malicious (refusal rate, with mitigations) | Claude Haiku 4.5 | 96.73% | same evaluation | 5.1.2 |
| Malicious use of Claude Code — Dual-use and benign (success rate, with mitigations) | Claude Haiku 4.5 | 86.07% | same evaluation | 5.1.2 |
| Malicious computer use — Refusal rate (without mitigations) | Claude Opus 4.6 | 88.34% | 112 tasks run with both extended and standard thinking (224 attempts per model); GUI- and CLI-based tools in a sandbox; developer-reported | 5.1.3 |
| Malicious computer use — Refusal rate (without mitigations) | Claude Opus 4.5 | 88.39% | same evaluation | 5.1.3 |
| Malicious computer use — Refusal rate (without mitigations) | Claude Sonnet 4.5 | 86.08% | same evaluation | 5.1.3 |
| Malicious computer use — Refusal rate (without mitigations) | Claude Haiku 4.5 | 77.68% | same evaluation | 5.1.3 |
| Agent Red Teaming (ART) benchmark — Indirect prompt injection, k=100, no extended thinking | Claude Opus 4.6 | 14.8% | attack success probability after 100 attempts; evaluated by Gray Swan; benchmark developed with the UK AI Security Institute; 19 scenarios; grading issues corrected jointly with Gray Swan | 5.2.1 |
| Agent Red Teaming (ART) benchmark — Indirect prompt injection, k=100, extended thinking | Claude Opus 4.6 | 21.7% | attack success probability after 100 attempts, extended thinking enabled; evaluated by Gray Swan | 5.2.1 |
| Agent Red Teaming (ART) benchmark — Indirect prompt injection, k=100, no extended thinking | Claude Opus 4.5 | 16.5% | attack success probability after 100 attempts; evaluated by Gray Swan | 5.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 1 attempt | Claude Opus 4.6 | 0.0% | attack success rate; Gray Swan Shade adaptive red-teaming tool; developer-reported | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 200 attempts | Claude Opus 4.6 | 0.0% | adaptive attacker with 200 attempts per goal | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 1 attempt | Claude Opus 4.6 | 0.0% | safeguards applied on tool responses | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 200 attempts | Claude Opus 4.6 | 0.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.6 | 0.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.6 | 0.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 1 attempt | Claude Opus 4.6 | 0.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 200 attempts | Claude Opus 4.6 | 0.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 1 attempt | Claude Opus 4.5 | 0.3% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 200 attempts | Claude Opus 4.5 | 10.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 1 attempt | Claude Opus 4.5 | 0.1% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 200 attempts | Claude Opus 4.5 | 7.5% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.5 | 0.7% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.5 | 17.5% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 1 attempt | Claude Opus 4.5 | 0.2% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 200 attempts | Claude Opus 4.5 | 7.5% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 1 attempt | Claude Sonnet 4.5 | 18.3% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, no safeguards, 200 attempts | Claude Sonnet 4.5 | 70.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 1 attempt | Claude Sonnet 4.5 | 1.6% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Extended thinking, with safeguards, 200 attempts | Claude Sonnet 4.5 | 25.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 1 attempt | Claude Sonnet 4.5 | 31.6% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, no safeguards, 200 attempts | Claude Sonnet 4.5 | 87.5% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 1 attempt | Claude Sonnet 4.5 | 1.7% | same evaluation | 5.2.2.1 |
| Shade prompt injection (coding) — Standard thinking, with safeguards, 200 attempts | Claude Sonnet 4.5 | 25.0% | same evaluation | 5.2.2.1 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 1 attempt | Claude Opus 4.6 | 17.8% | stronger Gray Swan attacker variant in GUI computer-use environments; developer-reported | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 200 attempts | Claude Opus 4.6 | 78.6% | adaptive attacker, 200 attempts per goal | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 1 attempt | Claude Opus 4.6 | 9.7% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 200 attempts | Claude Opus 4.6 | 57.1% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.6 | 20.0% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.6 | 85.7% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 1 attempt | Claude Opus 4.6 | 10.0% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 200 attempts | Claude Opus 4.6 | 64.3% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 1 attempt | Claude Opus 4.5 | 28.0% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 200 attempts | Claude Opus 4.5 | 78.6% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 1 attempt | Claude Opus 4.5 | 17.3% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 200 attempts | Claude Opus 4.5 | 64.3% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.5 | 35.4% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.5 | 85.7% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 1 attempt | Claude Opus 4.5 | 18.8% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 200 attempts | Claude Opus 4.5 | 71.4% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 1 attempt | Claude Sonnet 4.5 | 41.8% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, no safeguards, 200 attempts | Claude Sonnet 4.5 | 92.9% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 1 attempt | Claude Sonnet 4.5 | 25.2% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Extended thinking, with safeguards, 200 attempts | Claude Sonnet 4.5 | 85.7% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 1 attempt | Claude Sonnet 4.5 | 19.0% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, no safeguards, 200 attempts | Claude Sonnet 4.5 | 92.9% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 1 attempt | Claude Sonnet 4.5 | 12.8% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use) — Standard thinking, with safeguards, 200 attempts | Claude Sonnet 4.5 | 71.4% | same evaluation | 5.2.2.2 |
| Shade prompt injection (computer use, original attacker) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.6 | 0.29% | original (weaker) attacker evaluation, reported for consistency with prior cards | 5.2.2.2 |
| Shade prompt injection (computer use, original attacker) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.6 | 7.14% | original attacker evaluation | 5.2.2.2 |
| Shade prompt injection (computer use, original attacker) — Standard thinking, no safeguards, 1 attempt | Claude Opus 4.5 | 0.71% | original attacker evaluation | 5.2.2.2 |
| Shade prompt injection (computer use, original attacker) — Standard thinking, no safeguards, 200 attempts | Claude Opus 4.5 | 28.6% | original attacker evaluation; both models remain at 0% with extended thinking | 5.2.2.2 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of scenarios | Claude Opus 4.6 | 2.06% | 10 attack strings across 389 scenarios; per-scenario ASR (at least one attempt succeeded); developer-reported | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of attempts | Claude Opus 4.6 | 0.29% | per-attempt ASR aggregated across environments | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of scenarios | Claude Opus 4.6 | 2.83% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of attempts | Claude Opus 4.6 | 0.49% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of scenarios | Claude Opus 4.5 | 18.77% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of attempts | Claude Opus 4.5 | 6.40% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of scenarios | Claude Opus 4.5 | 16.20% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of attempts | Claude Opus 4.5 | 5.06% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of scenarios | Claude Sonnet 4.5 | 54.24% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Extended thinking, no safeguards, % of attempts | Claude Sonnet 4.5 | 20.45% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of scenarios | Claude Sonnet 4.5 | 49.36% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, no safeguards, % of attempts | Claude Sonnet 4.5 | 16.23% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of scenarios | Claude Opus 4.6 | 0.26% | with the safeguards deployed alongside Claude Opus 4.5 | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of attempts | Claude Opus 4.6 | 0.03% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of scenarios | Claude Opus 4.6 | 0.77% | with the updated safeguards | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of attempts | Claude Opus 4.6 | 0.08% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of scenarios | Claude Opus 4.5 | 1.03% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of attempts | Claude Opus 4.5 | 0.21% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of scenarios | Claude Opus 4.5 | 1.54% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of attempts | Claude Opus 4.5 | 0.40% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of scenarios | Claude Sonnet 4.5 | 1.54% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, previous safeguards, % of attempts | Claude Sonnet 4.5 | 0.41% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of scenarios | Claude Sonnet 4.5 | 2.06% | same evaluation | 5.2.2.3 |
| Browser-use prompt injection (internal Best-of-N) — Standard thinking, updated safeguards, % of attempts | Claude Sonnet 4.5 | 0.46% | same evaluation | 5.2.2.3 |
| Reward-hack-prone coding tasks — Classifier hack rate | Claude Opus 4.6 | 0% | hand-selected coding problems from the training distribution on which previous models hacked frequently; developer-reported | 6.2.3.2 |
| Reward-hack-prone coding tasks — Hidden test hack rate | Claude Opus 4.6 | 0% | held-out subset of tests | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with no prompt | Claude Opus 4.6 | 50% | agentic setting on intentionally impossible problems; minimal instructions | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with anti-hack prompt | Claude Opus 4.6 | 23% | with the anti-reward-hacking prompt | 6.2.3.2 |
| Reward-hack-prone coding tasks — Classifier hack rate | Claude Opus 4.5 | 0% | same evaluation | 6.2.3.2 |
| Reward-hack-prone coding tasks — Hidden test hack rate | Claude Opus 4.5 | 0% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with no prompt | Claude Opus 4.5 | 55% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with anti-hack prompt | Claude Opus 4.5 | 35% | same evaluation | 6.2.3.2 |
| Reward-hack-prone coding tasks — Classifier hack rate | Claude Haiku 4.5 | 6% | same evaluation | 6.2.3.2 |
| Reward-hack-prone coding tasks — Hidden test hack rate | Claude Haiku 4.5 | 3% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with no prompt | Claude Haiku 4.5 | 30% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with anti-hack prompt | Claude Haiku 4.5 | 23% | same evaluation | 6.2.3.2 |
| Reward-hack-prone coding tasks — Classifier hack rate | Claude Sonnet 4.5 | 1% | same evaluation | 6.2.3.2 |
| Reward-hack-prone coding tasks — Hidden test hack rate | Claude Sonnet 4.5 | 1% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with no prompt | Claude Sonnet 4.5 | 53% | same evaluation | 6.2.3.2 |
| Impossible tasks — Classifier hack rate with anti-hack prompt | Claude Sonnet 4.5 | 20% | same evaluation | 6.2.3.2 |
| Mentions of being evaluated (UK AISI) — Verbalized evaluation awareness | Claude Opus 4.6 | 2.3% | share of interactions; measured by the UK AI Security Institute on an early snapshot over 3 working days | 6.2.6 |
| Mentions of being evaluated (UK AISI) — Verbalized evaluation awareness | Claude Sonnet 4.5 | 11.4% | measured by the UK AI Security Institute | 6.2.6 |
| Mentions of being evaluated (UK AISI) — Verbalized evaluation awareness | Claude Opus 4.5 | 11.0% | measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Paired comparison (which of two conversations was an evaluation) | Claude Opus 4.6 | 80% | prompted identification accuracy; measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Paired comparison | Claude Sonnet 4.5 | 62% | measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Paired comparison | Claude Opus 4.5 | 72% | measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Single-interaction recognition | Claude Opus 4.6 | 45.5% | recognising a single interaction as an evaluation; measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Single-interaction recognition | Claude Sonnet 4.5 | 15% | measured by the UK AI Security Institute | 6.2.6 |
| Distinguishing deployment from simulation (UK AISI) — Single-interaction recognition | Claude Opus 4.5 | 12.5% | measured by the UK AI Security Institute | 6.2.6 |
| Refusal on safety research tasks (UK AISI) — Refusal rate | Claude Opus 4.6 | 26% | share of interactions refusing safety research tasks; measured by the UK AI Security Institute | 6.2.6 |
| Refusal on safety research tasks (UK AISI) — Refusal rate | Claude Sonnet 4.5 | 62% | measured by the UK AI Security Institute | 6.2.6 |
| Refusal on safety research tasks (UK AISI) — Refusal rate | Claude Opus 4.5 | 60% | measured by the UK AI Security Institute | 6.2.6 |
| Refusal to assist with AI safety R&D (internal) — Refusal rate | Claude Opus 4.6 | 14% | single-turn queries in a coding setting with user background context; developer-reported | 6.3.6 |
| Refusal to assist with AI safety R&D (internal) — Refusal rate | Claude 4.5 models | around 60% | as stated in prose for "all of the Claude 4.5 models"; per-model figures appear only in Figure 6.3.6.A | 6.3.6 |
| Self-preference evaluation — Self-favoritism, ten-point scale | Claude Opus 4.6 | less than 0.2 points | transcript-grading task; grader told the transcript came from Claude or another frontier model | 6.3.7 |
| Self-preference evaluation — Self-favoritism, ten-point scale | Claude Opus 4.5 | less than 0.2 points | same evaluation | 6.3.7 |
| Internal codebase sabotage propensity — Sabotage rate | Claude Opus 4.6 | never | crafted Claude Code scenario in which flagging is implied to be costly to Anthropic; also 9,000 resampled historical internal Claude Code queries with no sabotage flagged; developer-reported | 6.3.8 |
| Internal codebase sabotage propensity — Sabotage rate | Claude Opus 4.1 | 0.8% | same scenario, across multiple transcripts | 6.3.8 |
| SHADE-Arena — Extended Thinking (evasion success) | Claude Opus 4.6 | 18% | side task completed without being flagged by a Claude Sonnet 4 monitor; attacker prompting updated using cues from Zolkowski et al. (2025); developer-reported | 6.4.1 |
| SHADE-Arena — Extended Thinking (references side task in reasoning) | Claude Opus 4.6 | 26% | rate of referencing the secret side task in its thought process | 6.4.1 |
| SHADE-Arena — Extended Thinking (references side task in reasoning) | Claude Opus 4.5 | 74% | same measurement | 6.4.1 |
| SHADE-Arena — No extended thinking (evasion success) | Claude Opus 4.6 | 16% | side task completed without being caught by the monitor | 6.4.1 |
| SHADE-Arena — No extended thinking (evasion success) | Claude Sonnet 4.5 | 23% | same setting | 6.4.1 |
| SHADE-Arena — No extended thinking (evasion success) | Claude Opus 4.5 | 26% | same setting | 6.4.1 |
| SHADE-Arena — Hidden scratchpad (evasion success) | Claude Opus 4.6 | 46% | agent given a fully hidden scratchpad invisible to the monitor; described as an approximate upper bound; Opus 4.5 performs similarly | 6.4.1 |
| Long-form virology task 1 (influenza) — CBRN RSP evaluation | Claude Opus 4.6 | 0.79 | "max of 5" score; task-based agentic evaluation developed with SecureBio, Deloitte and Signature Science; developer-reported | 8.2.4.1 |
| Long-form virology task 1 (influenza) — CBRN RSP evaluation | Claude Opus 4.5 | 0.845 | "max of 5" score | 8.2.4.1 |
| Long-form virology task 1 (influenza) — CBRN RSP evaluation | Claude Sonnet 4.5 | 0.89 | "max of 5" score | 8.2.4.1 |
| Long-form virology task 2 (SARS-CoV) — CBRN RSP evaluation | Claude Opus 4.6 | 0.9 | "max of 5" score; exceeds the 0.8 threshold | 8.2.4.1 |
| Long-form virology task 2 (SARS-CoV) — CBRN RSP evaluation | Claude Opus 4.5 | 0.912 | "max of 5" score | 8.2.4.1 |
| Long-form virology task 2 (SARS-CoV) — CBRN RSP evaluation | Claude Sonnet 4.5 | 0.88 | "max of 5" score | 8.2.4.1 |
| Long-form virology tasks — Thresholds | Threshold | rule-out <50%; ASL-3 rule-in >80% | Anthropic's stated zones; scores between require additional evaluation | 8.2.4.1 |
| Creative Biology Uplift Trial — Model-assisted vs. control | Claude Opus 4.6 | roughly twice the score of the control group | twenty molecular biology PhDs split into a model-assisted group (Claude.ai with web search and extended thinking) and an internet-only control; up to 20 hours over three days; graded by multiple expert graders; no statistically significant difference between Opus 4.5 and Opus 4.6 | 8.2.4.4 |
| ASL-4 virology protocol uplift trial — Fractional score | Claude Opus 4.6 | 0.52 | average protocol score of the model-assisted group; trial and rubric designed by Deloitte Consulting; model-assisted and control groups had 3 days | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Fractional score | Claude Opus 4.5 | 0.61 | same trial; groups had 4 days | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Fractional score | Claude Opus 4 | 0.50 | same trial; groups had 2 days | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Critical failures | Claude Opus 4.6 | 6.6 critical failures | mean over the model-assisted group; above the rule-out threshold of 1.8 | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Critical failures | Claude Opus 4.5 | 5.6 critical failures | mean over the model-assisted group | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Critical failures | Claude Opus 4 | 8.4 critical failures | mean over the model-assisted group | 8.2.4.5 |
| ASL-4 virology protocol uplift trial — Threshold | Threshold | <1.8 out of 18 | updated threshold: <10% mean total critical failures on the model-assisted group (previously <25%, i.e. 4.5 out of 18) | 8.2.4.5 |
| Creative Biology Automated Evaluations — SecureBio creative biology questions | Claude Opus 4.6 | 0.603 | developer-reported | 8.2.4.8 |
| Creative Biology Automated Evaluations — SecureBio creative biology questions | Claude Opus 4.5 | 0.524 | same evaluation | 8.2.4.8 |
| Creative Biology Automated Evaluations — SecureBio creative biology questions | Claude Sonnet 4.5 | 0.488 | same evaluation | 8.2.4.8 |
| Creative Biology Automated Evaluations — Human baseline | Biology PhDs (SecureBio preliminary baselining) | 14% | preliminary human baselining on a subset of the questions | 8.2.4.8 |
| Short-horizon computational biology tasks — Lower-bound rule-out thresholds crossed | Claude Opus 4.6 | 6/6 tasks | developed with Faculty.ai; first Anthropic model to cross the lower-bound rule-out thresholds on all six tasks | 8.2.4.9 |
| Kernels task — Best speedup, experimental scaffold | Claude Opus 4.6 | 427× | AI R&D evaluation; mean score exceeded the 100× threshold; developer-reported | 8.3.3.1 |
| Kernels task — Best speedup, standard scaffold | Claude Opus 4.6 | 190× | standard scaffold | 8.3.3.1 |
| Kernels task — Thresholds | Threshold | 100× (4× ≈ 1 human hour; 200× ≈ 8 hours; 300× ≈ 40 hours) | Anthropic's stated threshold and human-time estimates | 8.3.3.1 |
| Time series forecasting — Hard variant (MSE) | Claude Opus 4.6 | 5.86 | minimum MSE; above (worse than) the human baseline of 5.3; lower is better | 8.3.3.2 |
| Time series forecasting — Medium variant (MSE) | Claude Opus 4.6 | 5.76 | minimum MSE; below the human baseline of 5.8; medium threshold estimated at 8 human hours | 8.3.3.2 |
| Time series forecasting — Human baseline, hard variant | Human baseline | 5.3 | MSE; lower is better | 8.3.3.2 |
| Time series forecasting — Human baseline, medium variant | Human baseline | 5.8 | MSE; lower is better | 8.3.3.2 |
| Text-based reinforcement learning task — Best score | Claude Opus 4.6 | 0.975 | above the 0.9 threshold, estimated to represent 8 human-effort hours; mean score also above threshold for the first time | 8.3.3.3 |
| Text-based reinforcement learning task — Threshold | Threshold | 0.9 | Anthropic's stated threshold | 8.3.3.3 |
| LLM training — Speedup | Claude Opus 4.6 | 34× | well above the 4× reference expert solution, which represents 4–8 human-effort hours | 8.3.3.4 |
| Quadruped reinforcement learning — Highest score, no hyperparameter variant | Claude Opus 4.6 | 20.96 | above the threshold of 12, representing 4 human-effort hours; median also above threshold | 8.3.3.5 |
| Quadruped reinforcement learning — Highest score, no reward function variant | Claude Opus 4.6 | 21.99 | above the threshold of 12 | 8.3.3.5 |
| Novel compiler — Basic tests pass rate | Claude Opus 4.6 | 98.2% | developer-reported | 8.3.3.6 |
| Novel compiler — Complex tests pass rate | Claude Opus 4.6 | 65.83% | below the 90% threshold, estimated to represent 40 human-effort hours | 8.3.3.6 |
| Internal AI research evaluation suite 2 — Weighted average score | Claude Opus 4.6 | 0.6124 | surpassing the rule-out threshold of 0.6; developer-reported | 8.3.4 |
| Internal AI research evaluation suite 2 — Weighted average score | Claude Opus 4.5 | 0.604 | same evaluation | 8.3.4 |
| Internal model use survey — L4 drop-in replacement question | Claude Opus 4.6 | 11 of 16 unlikely; 3 likely with 3 months of improvements; 2 already possible | survey of sixteen Anthropic technical staff, including general research and infrastructure/maintenance roles | 8.3.1 |
| Internal productivity uplift survey — Productivity uplift from using the model | Claude Opus 4.6 | 30% to 700% range; mean 152%; median 100% | sixteen Anthropic technical staff; more modest than previous superuser-focused surveys | 8.3.1 |
| RSP cyber: Web CTFs — Challenges solved | Claude Opus 4.6 | 13 out of 13 total | 15 web CTF challenges described (11 easy, 2 medium, 2 hard); pass@30; Kali-based environment with standard penetration-testing tools | 8.4.2 |
| RSP cyber: Crypto CTFs — Challenges solved | Claude Opus 4.6 | 16 out of 18 total | 22 crypto CTF challenges described (7 easy, 6 medium, 9 hard); pass@30 | 8.4.3 |
| RSP cyber: Pwn CTFs — Challenges solved | Claude Opus 4.6 | 5 out of 7 total | 9 pwn CTF challenges described (5 easy, 2 medium, 2 hard); pass@30 | 8.4.4 |
| RSP cyber: Rev CTFs — Challenges solved | Claude Opus 4.6 | 6 out of 6 total | 8 rev CTF challenges described (5 easy, 2 medium, 1 hard); pass@30 | 8.4.5 |
| RSP cyber: Network CTFs — Challenges solved | Claude Opus 4.6 | 5 out of 5 total | 4 network CTF challenges described (1 easy, 3 medium); pass@30 | 8.4.6 |
Discrepancies noted
The card gives Claude Opus 4.6's ARC-AGI-2 score as 69.17% in section 2.9 (120k thinking tokens, high effort, private dataset) and as 68.8% in table 2.3.A, and Claude Opus 4.5's MMMU-Pro score as 70.7% in section 2.19.2 and 70.6% in table 2.3.A. Both figures are recorded above.
Relationships
- supports: Mechanistic Interpretability — first production use of SAE/attribution-graph tools for alignment
- supports: AI Autonomy Risk — sabotage concealment + overly agentic behavior findings
- supports: AI Scheming — evaluation-integrity assessment; sabotage risk follow-on
- related: Claude Opus 4.6 — model page
- related: Anthropic's Responsible Scaling Policy (Version 3.1) — RSP v3.1 defines the ASL-3 Standard applied
- related: Anthropic Sabotage Risk Report: Claude Opus 4.6 — follow-on dedicated sabotage report
- related: METR Review of Anthropic's Sabotage Risk Report (Opus 4.6) — external review of that report
- related: Claude Opus 4.7 System Card — successor system card; Opus 4.7 does not advance the frontier
- related: Anthropic — author