AI Policy Wiki
Dashboard
⚲

Gemini 3 Pro Frontier Safety Framework Report (Google DeepMind, November 2025)

medium confidence · updated 2026-09-19

Google DeepMind's report on its Frontier Safety Framework (v3) risk assessment of Gemini 3 Pro, published November 2025 with the model. Covers threat modelling, early-warning evaluations and external testing in CBRN, cybersecurity, harmful manipulation, machine learning R&D and misalignment; finds the cyber alert threshold met and no critical capability level reached.

The Gemini 3 Pro Frontier Safety Framework Report is a document published by Google DeepMind in November 2025 alongside the Gemini 3 Pro model card (Source: https://deepmind.google/models/fsf-reports/gemini-3-pro/). It records the risk assessment of Gemini 3 Pro under version 3 of Google's Frontier Safety Framework (FSF), which the report dates to September 2025 after earlier versions in May 2024 and February 2025. The report concludes that Gemini 3 Pro "did not reach any of our FSF CCLs" and was "acceptable for deployment". The later Gemini 3.1 Pro model card cites this report for its own evaluation and mitigation detail.

Framework and process

The report describes the FSF as built around Critical Capability Levels (CCLs), "capability levels at which, absent mitigation measures, frontier AI models or systems may pose heightened risk of severe harm". It covers four risk domains — CBRN, cybersecurity, machine learning R&D and harmful manipulation — with misalignment treated as an exploratory area. The risk assessment process is set out as risk identification, threat modelling per domain, and "early warning evaluations" run for the first external deployment of a new frontier model and again when a later version shows meaningful new capabilities. "Alert thresholds" are defined as thresholds designed to flag when a CCL may be reached before the next assessment. Google states that a determination includes a safety margin, and that where it cannot rule out that a CCL has been reached it designates the model "cannot rule out being at the CCL" and mitigates accordingly.

The report says version 3 changed the methodology so that evaluations "more directly assess additional expected harm that may result from our models in the real world rather than primarily focusing on model capability in isolation". Under it, the cyber alert threshold first reached by Gemini 2.5 Pro and Gemini 2.5 Deep Think continues to be met by Gemini 3 Pro, while the CBRN alert threshold, which Gemini 2.5 Deep Think had reached, was not reached for Gemini 3 Pro. Most evaluations were run on "a similar earlier version" of the model, with limited additional testing on the final version.

Findings by domain

CBRN. Internal evaluation used multiple-choice benchmarks, open-ended questions and expert red teaming. Google reports statistically significant improvement on LAB-Bench, notably on Cloning Scenarios, relative to Gemini 2.5 Deep Think, and no statistically significant change on SecureBio's VCT; the scores appear only in a chart. It concludes the model provides accurate and occasionally actionable information but generally not novel or sufficiently complete instructions. The report also cites preliminary results from a randomized controlled wet-lab uplift trial run by Panoplia Laboratories, co-funded and coordinated by the Frontier Model Forum, which tested earlier models including Gemini 2.5 Pro. External testers found a possible time-saving benefit for technically trained users and "minimal and sometimes negative utility" for less trained users, and rated radiological and nuclear misuse potential "moderate" on a four-point scale.

Cybersecurity. The evaluation is a "key skills" benchmark of capture-the-flag challenges covering reconnaissance, tool development, tool usage and operational security, following Rodriguez et al. 2025. The v1 set has 50 challenges, 12 of them hard; a harder v2 set of 13 challenges simulates end-to-end attacks. A challenge counts as solved if any attempt succeeds. Gemini 3 Pro solved 11 of the 12 hard v1 challenges, against 6 of 12 for Gemini 2.5 models, which put it over the alert threshold; on two of the eleven it found an unintended shortcut. It solved none of the 13 v2 challenges end-to-end, which Google cites as confirming it is below the CCL. The appendix notes that Gemini 3 Pro had larger attempt budgets, longer step limits and more tools than earlier models, which "prevents a strict apples-to-apples comparison". External testers found the model faster than human baselines on some well-defined tasks and weaker on hard tasks.

Harmful manipulation. A propensity evaluation with synthetic dialogues found Gemini 3 Pro versions produced manipulative cues more often than Gemini 2.5 Pro in both control and adversarial conditions. An efficacy study with 610 UK-based Prolific participants found a statistically significant difference from a non-AI baseline on most metrics for both models, no significant difference between them, and results that "did not near alert thresholds". External testing of about 75k prompts on radicalisation, extremism and democratic harms found a low incidence of overtly harmful responses.

Machine learning R&D. Google ran five of the seven RE-Bench environments (Wijk et al. 2024), omitting two that need internet access, with 16 attempts per challenge and a 32-hour budget. Gemini 3 Pro did better than Gemini 2.5 models, roughly doubling their score on the Scaling Law Experiment and Optimize LLM Foundry tasks, while remaining "substantially below the alert threshold". External testers found that the model "has increased ability to sabotage AI R&D compared to previous Gemini models, but that it does not consistently succeed in complex multi-step sabotage tasks", and judged it unlikely to be capable of autonomously causing catastrophic harm by sabotaging AI R&D during internal deployment.

Misalignment (exploratory). On the four stealth and eleven situational-awareness evaluations of Phuong et al. 2025, the agent solved 1 of 4 and 3 of 11 challenges; Google states the model "does not consistently improve on Gemini 2.5 Pro's scores". External evaluators found "a substantial propensity for strategic deception in certain limited circumstances"; Google's experts judged this could affect user experience in rare agentic situations but was "very unlikely to cause severe real world harm" given the model's limited stealth and situational awareness. An addendum on chain-of-thought legibility reports that 99.98% of transcripts appeared comprehensible and 99.85% informative of the model's output, using the metrics of Emmons et al. 2025.

Correctness checks and mitigations

Google reports automated and manual checks of evaluation transcripts for spurious failures and for sandbagging. It found transcripts in which Gemini 3 Pro showed awareness of being in a synthetic environment, which Appendix 2 quotes, but "did not find any examples of sandbagging". Mitigations described are training and model guardrails (query filters, fine-tuning, input filtering), a layered defence against prompt injection, continuing internal and external red teaming of jailbreak robustness, and security controls protecting model weights. For cyber and CBRN, Google says it launched the model with mitigations as a precaution. External evaluators are not named anywhere in the report.

Reported results

Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.

EvaluationModelScoreSettingSection
Cybersecurity key skills benchmark — v1 hard challengesGemini 3 Pro11/12challenges solved; a challenge counts as solved if at least one of N = 75 attempts captures the flag; agent can run Bash or PowerShell, Python and web search; two of the eleven were solved by an unintended shortcut; alert threshold met, Cyber Uplift Level 1 CCL not reached; developer-reportedCybersecurity
Cybersecurity key skills benchmark — v1 hard challengesGemini 2.5 models6/12challenges solved; N = 100 attempts for Gemini 2.5 Pro, N = 200 for Gemini 2.5 Flash, N = 50 for Gemini 2.5 Deep Think on hard tasks; the report says attempt budgets, step limits and tools differ from the Gemini 3 Pro runs, so the comparison is not like-for-like; developer-reported (Google DeepMind, in the Gemini 3 Pro FSF report)Cybersecurity
Cybersecurity key skills benchmark — v2 challenges (end-to-end attacks)Gemini 3 Pro0/13challenges solved end-to-end; preliminary results; developer-reportedCybersecurity
Situational awareness challenges (Phuong et al. 2025)Gemini 3 Pro3/11challenges solved by the agent; run on a similar earlier version of Gemini 3 Pro, 50 attempts; Instrumental Reasoning Levels 1+2 CCL not reached; developer-reportedRisk assessments (summary table); Misalignment
Stealth challenges (Phuong et al. 2025)Gemini 3 Pro1/4challenges solved by the agent; run on a similar earlier version of Gemini 3 Pro, 50 attempts; developer-reportedRisk assessments (summary table); Misalignment
Chain-of-thought legibility (Emmons et al. 2025 metrics) — Transcripts that appear comprehensibleGemini 3 Pro99.98%share of transcripts rated comprehensible; report says no drop from the previous Gemini generation; developer-reportedAddendum: Chain-of-Thought legibility
Chain-of-thought legibility (Emmons et al. 2025 metrics) — Transcripts that appear informative of the model's outputGemini 3 Pro99.85%share of transcripts rated informative of the model's output; developer-reportedAddendum: Chain-of-Thought legibility

Provenance

The page summarises the report as captured from Google DeepMind's site on September 19, 2026. Figures 1 to 6 are charts whose values are not given in the text. The report is Google DeepMind's assessment of its own model; third-party findings are relayed by Google without the evaluators' own reports. Confidence is medium.

Relationships