AI Policy Wiki
Dashboard
⚲

Grok 4.6 Model Card (xAI, August 2026)

medium confidence · updated 2026-09-19

SpaceXAI's 42-page model card for Grok 4.6, dated August 12, 2026 and revised August 17, reporting coding, knowledge-work, engineering, R&D, search, cyber, biological/chemical, jailbreak, output-safety and behaviour evaluations against peer models.

The Grok 4.6 Model Card is a 42-page document dated August 12, 2026, the day Grok 4.6 was released, and revised on August 17, 2026; it is published by xAI under its SpaceXAI trading name (Source: https://media.x.ai/v1/website/card-4p6-4cd2dc57.pdf). It describes Grok 4.6 as the latest release in a "1.5T-scale model family" developed with Cursor, with a pretraining cutoff of January 2026 and supplemental training data generated as late as June 2026. The card follows the structure of the Grok 4.5 Model Card (xAI, July 2026) and reports most results as bar charts with printed values, Grok 4.6 at high or xhigh thinking effort beside Grok 4.5 and Anthropic, OpenAI and Moonshot models at their stated effort settings.

Changelog

The August 17 revision renumbered sections, added PartBench and new DeepSearchQA results, moved KernelBenchInternal to version 1.1 on a harder task split, and "corrected eval results on HackerBench v0.2, Self-harm, MASK, LAB". The earlier values are not given.

Capability evaluations

Coding: CursorBench 3.2 (run by Cursor), APEX-SWE (Mercor), FrontierCode v1.1 extended set (Cognition), DeepSWE v1.1 (Datacurve), SWE-Marathon v1.1 (Abundant AI) and Terminal-Bench 3.0 (Harbor). Knowledge work: GDPval-AA v2 and AA-Briefcase (Artificial Analysis), APEX-Agents (Mercor), OfficeQA Pro (Databricks) and the Harvey Legal Agent Benchmark as implemented by Vals AI. Engineering: EEBench, 3DCodeBench, PartBench, CADGenBench and CADBench. R&D enablement: the internal SpaceXAI MTS Eval, InferenceEval and KernelBenchInternal v1.1; the card also recounts an earlier checkpoint working for five hours on its own inference stack and opening seven pull requests, three of which it says now serve production traffic. Search and factuality: an internal hallucination rate and DeepSearchQA. For DeepSWE the card says peer numbers "use the best result available from model cards or evaluator-reported sources". The card does not state trial counts or sampling for any benchmark.

Cyber

CyberGym, CVE-Bench and an internal SecureCodeReview evaluation are run without safeguards; CyberGym peer figures are taken from other developers' system cards. HackerBench v0.2 is run with each provider's standard safeguards and reported as harmful or dual-use compliance and benign refusal for five models. xAI states that gains over Grok 4.5 are concentrated in defence and vulnerability mitigation, and that an unrestricted configuration was given to third-party evaluators who corroborated its internal results; the evaluators are not named and no third-party figures are printed.

Biological and chemical

The suites are treated as safety-threshold evaluations under the xAI Frontier Artificial Intelligence Framework of June 30, 2026, and run without production safeguards: the Virology Capabilities Test, an internal Biosecurity VCT, the internal BioUseBench dual-use refusal rate, WMDP biology, chemistry and cyber, a LAB-Bench practical multiple-choice set, ProtocolQA Open-Ended and BixBench, each for Grok 4.5 and Grok 4.6. The card states that Grok 4.6 "scores below the FAIF safety thresholds on dual-use knowledge" and notes a limited increase over Grok 4.5 in the biological domain. Threshold values are not printed.

Safeguards and behaviour

Jailbreak robustness is reported as compliance on a standard battery, on StrongREJECT and on long-horizon multi-turn attacks including Crescendo. Output-safety sections report general refusals in six languages, child safety, CBRN refusal recall on Autointent-Bio and Autointent-Chem, and FORTRESS-RN refusal accuracy as run by Scale AI, followed by self-harm refusals, MASK-Rectified and an internal sycophancy measure. The card states that Grok 4.6 generally refuses more reliably than Grok 4.5; its tables show higher StrongREJECT, self-harm, MASK-Rectified and sycophancy rates for Grok 4.6 than for Grok 4.5.

Provenance and confidence

The figures are developer-assembled from runs by named evaluation partners, internal runs and other developers' system cards. The x.ai launch post of the same date gives 63.6% for Fable 5 on FrontierCode v1.1, a value the card assigns to Claude Opus 5, with 64.9% for Fable 5 (Source: https://x.ai/news/grok-4-6). Confidence is medium. The vault copy is the text layer of the official PDF; the HackerBench chart's value labels are positioned by bar and must be matched to the legend order.

Reported results

Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.

EvaluationModelScoreSettingSection
CursorBench 3.2Grok 4.670.8%xhigh thinking effort; Cursor agent harness, fixed task set, averaging 41,136 output tokens per task; evaluation conducted by Cursor; developer-reported2.1
CursorBench 3.2Grok 4.669.9%high thinking effort; Cursor agent harness, fixed task set; evaluation conducted by Cursor; developer-reported2.1
CursorBench 3.2Grok 4.566.7%high thinking effort; Cursor agent harness, fixed task set; Grok 4.5 was served with a maximum thinking effort of high; evaluation conducted by Cursor; developer-reported2.1
APEX-SWEClaude Opus 563.7%max effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEClaude Fable 558.8%max effort, with fallback; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEGrok 4.656.4%high thinking effort; Terminus-2 harness; Pass@1; evaluation conducted by Mercor; developer-reported2.2
APEX-SWEGrok 4.553.6%high thinking effort; Terminus-2 harness; Pass@1; evaluation conducted by Mercor; developer-reported2.2
APEX-SWEKimi K348.0%max effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEClaude Sonnet 546.4%max effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEGPT-5.6 Sol45.8%xhigh thinking effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEClaude Opus 4.843.9%max effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
APEX-SWEGPT-5.537.0%xhigh thinking effort; Pass@1; evaluation conducted by Mercor; reported by xAI in the Grok 4.6 model card2.2
FrontierCode v1.1 — Extended (150 samples)Claude Fable 564.9%max effort, with fallback; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)Claude Opus 563.6%max effort; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)Grok 4.661.3%high thinking effort; Grok Build harness; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; developer-reported2.3
FrontierCode v1.1 — Extended (150 samples)GPT-5.6 Sol60.6%max effort; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)Claude Opus 4.859.6%max effort; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)GPT-5.556.7%xhigh thinking effort; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)Grok 4.556.6%high thinking effort; Grok Build harness; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; developer-reported2.3
FrontierCode v1.1 — Extended (150 samples)Claude Sonnet 556.2%max effort; extended score, graded against maintainer-authored rubrics, verifiers and hard-blocker criteria; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
FrontierCode v1.1 — Extended (150 samples)SWE-1.7 (Cognition)54.3%reported without effort; extended score; evaluation conducted by Cognition; reported by xAI in the Grok 4.6 model card2.3
DeepSWE v1.1Claude Opus 574.0%max effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1GPT-5.6 Sol73.0%max effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1Claude Fable 570.0%max effort, with fallback; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1Kimi K369.0%max effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1Grok 4.667.0%xhigh thinking effort; mini-swe-agent harness; Pass@1; evaluation conducted by Datacurve; developer-reported2.4
DeepSWE v1.1GPT-5.567.0%xhigh thinking effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1Grok 4.665.9%high thinking effort; mini-swe-agent harness; Pass@1; evaluation conducted by Datacurve; developer-reported2.4
DeepSWE v1.1Claude Opus 4.859.0%max effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
DeepSWE v1.1Grok 4.554.0%high thinking effort; mini-swe-agent harness; Pass@1; evaluation conducted by Datacurve; developer-reported2.4
DeepSWE v1.1Claude Sonnet 554.0%max effort; best result available from model cards or evaluator-reported sources; Pass@1; evaluation conducted by Datacurve; reported by xAI in the Grok 4.6 model card2.4
SWE-Marathon v1.1Claude Opus 550.0%max effort; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1Claude Opus 4.848.8%max effort; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1Kimi K348.1%max effort; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1Claude Fable 545.0%max effort, with fallback; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1GPT-5.6 Sol42.5%max effort; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1Grok 4.631.9%high thinking effort; Grok Build harness; resolution rate; evaluation conducted by Abundant AI; developer-reported2.5
SWE-Marathon v1.1Claude Sonnet 530.0%max effort; provider harness; resolution rate; evaluation conducted by Abundant AI; reported by xAI in the Grok 4.6 model card2.5
SWE-Marathon v1.1Grok 4.529.4%high thinking effort; Grok Build harness; resolution rate; evaluation conducted by Abundant AI; developer-reported2.5
AA-BriefcaseClaude Opus 51715 Elomax effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseGrok 4.61577 Elohigh thinking effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; developer-reported3.2
AA-BriefcaseClaude Fable 51574 Elomax effort, with fallback; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseKimi K31541 Elomax effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseGPT-5.6 Sol1502 Elomax effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseClaude Sonnet 51383 Elomax effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseClaude Opus 4.81340 Elomax effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
AA-BriefcaseGrok 4.51313 Elohigh thinking effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; developer-reported3.2
AA-BriefcaseGPT-5.51150 Eloxhigh thinking effort; Artificial Analysis harness, offline scenarios, rubric pass rate combined with pairwise judgments; evaluation conducted by Artificial Analysis; reported by xAI in the Grok 4.6 model card3.2
OfficeQA ProGrok 4.663.2%high thinking effort; accuracy, Databricks harness; evaluation conducted by Databricks; developer-reported3.4
OfficeQA ProClaude Opus 560.9%max effort; accuracy, Databricks harness; evaluation conducted by Databricks; reported by xAI in the Grok 4.6 model card3.4
OfficeQA ProClaude Fable 560.9%max effort, with fallback; accuracy, Databricks harness; evaluation conducted by Databricks; reported by xAI in the Grok 4.6 model card3.4
OfficeQA ProGPT-5.6 Sol60.2%max effort; accuracy, Databricks harness; evaluation conducted by Databricks; reported by xAI in the Grok 4.6 model card3.4
Legal Agent Benchmark (LAB) — Vals AI implementationGrok 4.615.8%high thinking effort; Vals AI Valkyrie harness, six tools and three skills, internet access disabled, expert all-pass rubrics; evaluation conducted by Vals AI; developer-reported3.5
Legal Agent Benchmark (LAB) — Vals AI implementationGrok 4.512.9%high thinking effort; Vals AI Valkyrie harness, six tools and three skills, internet access disabled, expert all-pass rubrics; evaluation conducted by Vals AI; developer-reported3.5
Legal Agent Benchmark (LAB) — Vals AI implementationClaude Opus 511.7%max effort; Vals AI Valkyrie harness, six tools and three skills, internet access disabled, expert all-pass rubrics; evaluation conducted by Vals AI; reported by xAI in the Grok 4.6 model card3.5
Legal Agent Benchmark (LAB) — Vals AI implementationClaude Fable 511.3%max effort, with fallback; Vals AI Valkyrie harness, six tools and three skills, internet access disabled, expert all-pass rubrics; evaluation conducted by Vals AI; reported by xAI in the Grok 4.6 model card3.5
Legal Agent Benchmark (LAB) — Vals AI implementationGPT-5.6 Sol2.5%max effort; Vals AI Valkyrie harness, six tools and three skills, internet access disabled, expert all-pass rubrics; evaluation conducted by Vals AI; reported by xAI in the Grok 4.6 model card3.5
EEBench — V1 core corpusClaude Opus 561.6%max effort; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
EEBench — V1 core corpusGrok 4.660.0%xhigh thinking effort; Grok Build harness; reward; evaluation conducted by Atopile; developer-reported4.1
EEBench — V1 core corpusClaude Fable 554.2%max effort, with fallback; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
EEBench — V1 core corpusGrok 4.653.0%high thinking effort; Grok Build harness; reward; evaluation conducted by Atopile; developer-reported4.1
EEBench — V1 core corpusClaude Opus 4.851.4%max effort; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
EEBench — V1 core corpusGrok 4.550.9%high thinking effort; Grok Build harness; reward; evaluation conducted by Atopile; developer-reported4.1
EEBench — V1 core corpusGPT-5.542.3%xhigh thinking effort; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
EEBench — V1 core corpusGPT-5.6 Sol39.4%max effort; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
EEBench — V1 core corpusKimi K338.3%max effort; provider harness; reward; evaluation conducted by Atopile; reported by xAI in the Grok 4.6 model card4.1
3DCodeBenchGrok 4.654.0%high thinking effort; Grok Build harness; reward (executability and shape fidelity); evaluator not stated; developer-reported4.2
3DCodeBenchClaude Opus 549.9%max effort; reward (executability and shape fidelity); evaluator not stated; reported by xAI in the Grok 4.6 model card4.2
3DCodeBenchGrok 4.549.8%high thinking effort; Grok Build harness; reward (executability and shape fidelity); evaluator not stated; developer-reported4.2
3DCodeBenchClaude Opus 4.847.0%max effort; reward (executability and shape fidelity); evaluator not stated; reported by xAI in the Grok 4.6 model card4.2
3DCodeBenchClaude Fable 543.7%max effort, with fallback; reward (executability and shape fidelity); evaluator not stated; reported by xAI in the Grok 4.6 model card4.2
3DCodeBenchClaude Sonnet 539.2%max effort; reward (executability and shape fidelity); evaluator not stated; reported by xAI in the Grok 4.6 model card4.2
PartBenchClaude Fable 559.9%max effort, with fallback; provider harness; reward; evaluation conducted by Normal Factory; reported by xAI in the Grok 4.6 model card4.3
PartBenchGPT-5.6 Sol59.0%xhigh thinking effort; provider harness; reward; evaluation conducted by Normal Factory; reported by xAI in the Grok 4.6 model card4.3
PartBenchGrok 4.658.5%xhigh thinking effort; Grok Build harness; reward; evaluation conducted by Normal Factory; developer-reported4.3
PartBenchClaude Opus 552.4%max effort; provider harness; reward; evaluation conducted by Normal Factory; reported by xAI in the Grok 4.6 model card4.3
CADGenBench — Generation splitGrok 4.640.9%high thinking effort; Grok Build harness; reward (executability and geometric correctness); evaluation conducted by Mecado; developer-reported4.4
CADGenBench — Generation splitGPT-5.6 Sol37.1%xhigh thinking effort; provider harness; reward (executability and geometric correctness); evaluation conducted by Mecado; reported by xAI in the Grok 4.6 model card4.4
CADGenBench — Generation splitClaude Opus 536.6%max effort; provider harness; reward (executability and geometric correctness); evaluation conducted by Mecado; reported by xAI in the Grok 4.6 model card4.4
CADGenBench — Generation splitGrok 4.533.2%high thinking effort; Grok Build harness; reward (executability and geometric correctness); evaluation conducted by Mecado; developer-reported4.4
CADBenchClaude Opus 590.6%max effort; reward; Grok Build harness, run by gNucleus; reported by xAI in the Grok 4.6 model card4.5
CADBenchGrok 4.688.4%xhigh thinking effort; reward; Grok Build harness, run by gNucleus; developer-reported4.5
CADBenchGrok 4.687.8%high thinking effort; reward; Grok Build harness, run by gNucleus; developer-reported4.5
CADBenchGPT-5.6 Sol86.5%max effort; reward; Grok Build harness, run by gNucleus; reported by xAI in the Grok 4.6 model card4.5
CADBenchGrok 4.583.7%high thinking effort; reward; Grok Build harness, run by gNucleus; developer-reported4.5
SpaceXAI MTS Eval — Standard (non-GPU) suiteGrok 4.661.1%high thinking effort; Grok Build harness; % correct, task reward under a fixed rollout budget, internal benchmark, 29 tasks; developer-reported5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteGrok 4.557.1%high thinking effort; Grok Build harness; % correct, task reward under a fixed rollout budget, internal benchmark, 29 tasks; developer-reported5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteClaude Opus 4.855.8%max effort; % correct, task reward under a fixed rollout budget, internal benchmark, 29 tasks; reported by xAI in the Grok 4.6 model card5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteClaude Opus 552.6%max effort; % correct, task reward under a fixed rollout budget, internal benchmark, 29 tasks; reported by xAI in the Grok 4.6 model card5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteGPT-5.6 Sol52.1%xhigh thinking effort; % correct, internal benchmark; model refused 2 of 29 tasks and the score excludes them; reported by xAI in the Grok 4.6 model card5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteGPT-5.546.4%xhigh thinking effort; % correct, internal benchmark; model refused 1 task and the score excludes it; reported by xAI in the Grok 4.6 model card5.1
SpaceXAI MTS Eval — Standard (non-GPU) suiteGrok 4.340.6%effort not stated; % correct, internal benchmark; developer-reported5.1
InferenceEvalGrok 4.646.9%high thinking effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; developer-reported5.2
InferenceEvalGPT-5.6 Sol44.1%max effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; reported by xAI in the Grok 4.6 model card5.2
InferenceEvalClaude Opus 543.0%max effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; reported by xAI in the Grok 4.6 model card5.2
InferenceEvalGrok 4.541.3%high thinking effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; developer-reported5.2
InferenceEvalClaude Opus 4.840.7%max effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; reported by xAI in the Grok 4.6 model card5.2
InferenceEvalKimi K339.8%max effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; reported by xAI in the Grok 4.6 model card5.2
InferenceEvalGPT-5.538.9%xhigh thinking effort; accuracy, internal benchmark on the SpaceXAI production inference stack, Grok Build harness, hidden GPU unit score plus integration probe; reported by xAI in the Grok 4.6 model card5.2
KernelBenchInternal v1.1Claude Opus 548.1%max effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; reported by xAI in the Grok 4.6 model card5.3
KernelBenchInternal v1.1Kimi K341.0%max effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; reported by xAI in the Grok 4.6 model card5.3
KernelBenchInternal v1.1Claude Opus 4.837.5%max effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; reported by xAI in the Grok 4.6 model card5.3
KernelBenchInternal v1.1Grok 4.637.2%high thinking effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; developer-reported5.3
KernelBenchInternal v1.1GPT-5.6 Sol34.4%max effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; reported by xAI in the Grok 4.6 model card5.3
KernelBenchInternal v1.1GPT-5.534.0%xhigh thinking effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; reported by xAI in the Grok 4.6 model card5.3
KernelBenchInternal v1.1Grok 4.529.7%high thinking effort; accuracy (correctness and measured speedup against a TF32 PyTorch baseline), internal suite, Grok Build harness; developer-reported5.3
Factuality (Hallucination)Claude Opus 4.83.4%max effort; hallucination rate, lower is better; internal benchmark, separate grader, Grok Build harness; reported by xAI in the Grok 4.6 model card6.1
Factuality (Hallucination)Grok 4.61.7%high thinking effort; hallucination rate, lower is better; internal benchmark, separate grader, Grok Build harness; developer-reported6.1
Factuality (Hallucination)GPT-5.51.1%xhigh thinking effort; hallucination rate, lower is better; internal benchmark, separate grader, Grok Build harness; reported by xAI in the Grok 4.6 model card6.1
Factuality (Hallucination)Grok 4.50.98%high thinking effort; hallucination rate, lower is better; internal benchmark, separate grader, Grok Build harness; developer-reported6.1
DeepSearchQAGPT-5.587.8%xhigh thinking effort; accuracy, internal implementation of DeepSearchQA, Grok Build harness; reported by xAI in the Grok 4.6 model card6.2
DeepSearchQAGrok 4.585.3%high thinking effort; accuracy, internal implementation of DeepSearchQA, Grok Build harness; developer-reported6.2
DeepSearchQAClaude Opus 4.884.8%max effort; accuracy, internal implementation of DeepSearchQA, Grok Build harness; reported by xAI in the Grok 4.6 model card6.2
DeepSearchQAGrok 4.681.6%high thinking effort; accuracy, internal implementation of DeepSearchQA, Grok Build harness; developer-reported6.2
DeepSearchQAGPT-5.6 Sol75.0%high thinking effort; accuracy, internal implementation of DeepSearchQA, Grok Build harness; reported by xAI in the Grok 4.6 model card6.2
CVE-BenchGrok 4.535.2%high thinking effort; reward, Grok Build harness, without safeguards; developer-reported7.2
CVE-BenchGrok 4.639.8%high thinking effort; reward, Grok Build harness, without safeguards; developer-reported7.2
SecureCodeReviewGPT-5.564.1%xhigh thinking effort; reward, internal agentic evaluation, Grok Build harness; reported by xAI in the Grok 4.6 model card7.3
SecureCodeReviewGrok 4.658.7%high thinking effort; reward, internal agentic evaluation, Grok Build harness; developer-reported7.3
SecureCodeReviewGPT-5.6 Sol57.5%max effort; reward, internal agentic evaluation, Grok Build harness; reported by xAI in the Grok 4.6 model card7.3
SecureCodeReviewGrok 4.549.4%high thinking effort; reward, internal agentic evaluation, Grok Build harness; developer-reported7.3
HackerBench v0.2 — Harmful/Dual-Use ComplianceGrok 4.66.9%high thinking effort; share of harmful or dual-use requests complied with, lower is better; internal suite, run with each provider's standard safeguards; developer-reported7.4
HackerBench v0.2 — Harmful/Dual-Use ComplianceGrok 4.57.8%high thinking effort; share of harmful or dual-use requests complied with, lower is better; internal suite, run with each provider's standard safeguards; developer-reported7.4
HackerBench v0.2 — Harmful/Dual-Use ComplianceGPT-5.525.0%xhigh thinking effort; share of harmful or dual-use requests complied with, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
HackerBench v0.2 — Harmful/Dual-Use ComplianceClaude Opus 4.822.8%max effort; share of harmful or dual-use requests complied with, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
HackerBench v0.2 — Harmful/Dual-Use ComplianceGPT-5.6 Sol35.7%max effort; share of harmful or dual-use requests complied with, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
HackerBench v0.2 — Benign RefusalGrok 4.60.0%high thinking effort; share of benign tasks refused, lower is better; internal suite, run with each provider's standard safeguards; developer-reported7.4
HackerBench v0.2 — Benign RefusalGrok 4.50.0%high thinking effort; share of benign tasks refused, lower is better; internal suite, run with each provider's standard safeguards; developer-reported7.4
HackerBench v0.2 — Benign RefusalGPT-5.51.1%xhigh thinking effort; share of benign tasks refused, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
HackerBench v0.2 — Benign RefusalClaude Opus 4.80.0%max effort; share of benign tasks refused, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
HackerBench v0.2 — Benign RefusalGPT-5.6 Sol0.0%max effort; share of benign tasks refused, lower is better; internal suite, run with each provider's standard safeguards; reported by xAI in the Grok 4.6 model card7.4
Biosecurity VCTGrok 4.544.1%high thinking effort; overall accuracy over should-refuse and should-comply items, internal companion to VCT; developer-reported8.2
Biosecurity VCTGrok 4.647.8%high thinking effort; overall accuracy over should-refuse and should-comply items, internal companion to VCT; developer-reported8.2
BioUseBench — Dual-use refusal (severity-5 subset)Grok 4.583.3%high thinking effort; refusal rate on the highest-severity dual-use subset, internal suite; developer-reported8.3
BioUseBench — Dual-use refusal (severity-5 subset)Grok 4.690.7%high thinking effort; refusal rate on the highest-severity dual-use subset, internal suite; developer-reported8.3
BixBench zero-shot MCQGrok 4.593.8%high thinking effort; accuracy, zero-shot multiple choice, Grok Build default tool-on setting; developer-reported8.7
BixBench zero-shot MCQGrok 4.693.8%high thinking effort; accuracy, zero-shot multiple choice, Grok Build default tool-on setting; developer-reported8.7
Standard jailbreaksGrok 4.50.73%high thinking effort; compliance on should-refuse attacks, lower is better; internal battery, production safeguards; developer-reported9.1
Standard jailbreaksGrok 4.60.04%high thinking effort; compliance on should-refuse attacks, lower is better; internal battery, production safeguards; developer-reported9.1
Long-horizon jailbreaksGrok 4.61.0%high thinking effort; compliance on multi-turn, Crescendo and long-horizon malicious-use attacks, lower is better; production safeguards; Grok 4.5 not reported; developer-reported9.1
General refusalsGrok 4.51.10%high thinking effort; compliance, lower is better; internal harmful queries in six languages, model-graded; developer-reported10.1
General refusalsGrok 4.60.93%high thinking effort; compliance, lower is better; internal harmful queries in six languages, model-graded; developer-reported10.1
Child safetyGrok 4.50.00%high thinking effort; compliance, lower is better; internal multi-turn CSAM and child-safety suite; developer-reported10.2
Child safetyGrok 4.60.00%high thinking effort; compliance, lower is better; internal multi-turn CSAM and child-safety suite; developer-reported10.2
Autointent-Bio — Bio refusal recallGrok 4.597.9%high thinking effort; refusal recall on internal dangerous and benign biological queries; developer-reported10.3
Autointent-Bio — Bio refusal recallGrok 4.6100.0%high thinking effort; refusal recall on internal dangerous and benign biological queries; developer-reported10.3
Autointent-Chem — Chem refusal recallGrok 4.596.7%high thinking effort; refusal recall on internal dangerous and benign chemical queries; developer-reported10.3
Autointent-Chem — Chem refusal recallGrok 4.6100.0%high thinking effort; refusal recall on internal dangerous and benign chemical queries; developer-reported10.3
FORTRESS-RN — R/N refusal accuracyGrok 4.597.9%high thinking effort; refusal accuracy on radiological and nuclear items; evaluation conducted by Scale AI; developer-reported10.3
FORTRESS-RN — R/N refusal accuracyGrok 4.697.9%high thinking effort; refusal accuracy on radiological and nuclear items; evaluation conducted by Scale AI; developer-reported10.3
Self-harm refusalsGrok 4.50.50%high thinking effort; compliance (failure rate, including refusing without redirecting to help), lower is better; internal suite; developer-reported11.1
Self-harm refusalsGrok 4.60.84%high thinking effort; compliance (failure rate, including refusing without redirecting to help), lower is better; internal suite; developer-reported11.1
MASK-RectifiedGrok 4.50.67%high thinking effort; dishonesty, lower is better; dataset derived from MASK with grading corrected so that evident role-play is not counted as lying; developer-reported12.1
MASK-RectifiedGrok 4.61.90%high thinking effort; dishonesty, lower is better; dataset derived from MASK with grading corrected so that evident role-play is not counted as lying; developer-reported12.1
SycophancyGrok 4.50.01%high thinking effort; sycophancy, lower is better; internal benchmark with misleading user-supplied context; developer-reported12.2
SycophancyGrok 4.60.04%high thinking effort; sycophancy, lower is better; internal benchmark with misleading user-supplied context; developer-reported12.2

Relationships