The GLM-5.3 model card is the README of the zai-org/GLM-5.3 repository on Hugging Face, published by Z.ai when it released the weights of GLM-5.3 under the GLM-5.3 License; the repository's first public commit is dated August 27–28, 2026, two weeks after the model's API launch on August 14 (Source: huggingface.co). Like the GLM-5.2 card it is a model card rather than a system card: it reports capability benchmarks, including three offensive-security benchmarks, but no refusal, misuse-safeguard or alignment evaluations.
Model description
The card states that GLM-5.3 uses the same base model as GLM-5.2 and that "every gain comes from post-training." It makes two claims. On coding, Z.ai calls GLM-5.3 the most capable open-weights model, reports a 50% improvement over GLM-5.2 on its in-house Z.ai Code Bench without giving absolute scores, and claims the best open-source results on Terminal Bench 3.0 and Agents' Last Exam. On security, under the heading "Emergent Cyber Capability," it says cyber capability "developed faster than we expected" as post-training was scaled, that GLM-5.3 leads on CyberGym for vulnerability discovery, and that it more than doubles GLM-5.2 on exploitation benchmarks. The card notes that the reasoning_effort parameter accepts low, high and max, defaults to max, and should be left at the default when reproducing benchmark results.
Evaluation approach
The benchmark table has eight columns — GLM-5.3, GLM-5.2, Kimi K3, DeepSeek-V4 Pro-0813, Qwen3.8-Max, Opus 4.8, "Fable 5 (w/ fallback)" and GPT-5.6 Sol — and marks the best figure in each row in bold. GLM-5.3 is bolded on three rows: CyberGym, AutomationBench and GDPval-AA v2.
- Coding and long-horizon engineering: Terminal Bench 2.1 and 3.0, DeepSWE v1.1, NL2Repo, ProgramBench (reported as the share of tasks "Almost Solved"), FrontierSWE, SWE-Marathon v1.1 and PostTrainBench. Seven of the footnotes name Claude Code 2.1.207 as the harness, generally at maximum reasoning effort. Terminal-Bench 3.0 is reported as the average of three rollouts per task with a 600-turn cap and a 10-hour timeout. FrontierSWE was run by Proximal, with a Dominance score as of August 14, 2026. For PostTrainBench and SWE-Marathon the footnotes disclose changes to the benchmarks' own checks: pattern-matching checks for third-party API use and an import-detection anti-cheat check were replaced with inspection by a language model, because Z.ai found they produced false positives.
- Cybersecurity: CyberGym (single-run pass@1 over 1,507 tasks with no per-task time limit), ExploitGym (tasks solved out of 869 under two-hour and six-hour budgets) and ExploitBench (average capability coverage over 41 tasks, taking the union of capabilities reached across three revisions, with at most 300 interaction rounds). Each was run in Claude Code without web tools and with a domain whitelist that the card says is meant "to prevent the agent from cheating"; for CyberGym, Git-related information was also removed and the agent was placed inside the task container. The ExploitGym budgets are not wall-clock limits: Z.ai computed them from API inference time rescaled by each model's tokens-per-second rate as published by Artificial Analysis, and states that it ran GLM-5.3, Kimi K3 and Qwen3.8-Max this way.
- Agentic and knowledge work: Toolathlon Verified (official service, pass@1 averaged over three runs), AutomationBench v1.0.6, Agents' Last Exam in its command-line form (105 tasks, official evaluators), Humanity's Last Exam with tools (300,000-token context with a context-management strategy, GPT-5.6 Luna as judge) and GDPval-AA v2, which the card says was evaluated by Artificial Analysis.
Several GLM-5.2 figures differ from those in the GLM-5.2 card because the benchmark version or metric changed, for example SWE-Marathon (13.0, then 19.4 on v1.1) and ProgramBench (63.7, then 9.5 "Almost Solved"). The card does not identify the source of the comparison models' figures beyond the ExploitGym footnote.
Reported results
Evaluation results the document states for which there is no separate benchmark page; results on benchmarks that have a page are recorded there and cite this page. Scores and settings are as printed in the document.
| Evaluation | Model | Score | Setting | Section |
|---|---|---|---|---|
| DeepSWE (v1.1) | GLM-5.3 | 66.9% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; developer-reported | Benchmark; Footnotes |
| DeepSWE (v1.1) | GLM-5.2 | 46.2% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; developer-reported | Benchmark; Footnotes |
| DeepSWE (v1.1) | Kimi K3 | 67.5% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| DeepSWE (v1.1) | DeepSeek-V4 Pro-0813 | 62.7% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| DeepSWE (v1.1) | Qwen3.8-Max | 56.6% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| DeepSWE (v1.1) | Claude Opus 4.8 | 58.0% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| DeepSWE (v1.1) | Claude Fable 5 (w/ fallback) | 69.7% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| DeepSWE (v1.1) | GPT-5.6 Sol | 72.7% | mini-swe-agent harness; temperature 0.95, top_p 1.0, 6h timeout, 400K context; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| NL2Repo | GLM-5.3 | 58.0% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; developer-reported | Benchmark; Footnotes |
| NL2Repo | GLM-5.2 | 48.9% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; developer-reported | Benchmark; Footnotes |
| NL2Repo | Kimi K3 | 58.0% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| NL2Repo | DeepSeek-V4 Pro-0813 | 61.1% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| NL2Repo | Qwen3.8-Max | 55.9% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| NL2Repo | Claude Opus 4.8 | 69.7% | temperature 1.0, top_p 1.0, max_new_tokens 64k, 1M context; rule-based and LLM-based checks against unauthorized pip or curl operations; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | GLM-5.3 | 19.0% | 'Almost Solved' metric; setting not stated; developer-reported | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | GLM-5.2 | 9.5% | 'Almost Solved' metric; setting not stated; developer-reported | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | Kimi K3 | 17.5% | 'Almost Solved' metric; setting not stated; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | Qwen3.8-Max | 10.5% | 'Almost Solved' metric; setting not stated; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | Claude Opus 4.8 | 15.5% | 'Almost Solved' metric; setting not stated; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | Claude Fable 5 (w/ fallback) | 33.0% | 'Almost Solved' metric; setting not stated; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| ProgramBench (Almost Solved) | GPT-5.6 Sol | 23.0% | 'Almost Solved' metric; setting not stated; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| FrontierSWE | GLM-5.3 | 78.1% | evaluation conducted by Proximal; 1M context, max effort, 128K maximum output tokens; Dominance score as of 2026-08-14; developer-reported | Benchmark; Footnotes |
| FrontierSWE | GLM-5.2 | 67.5% | evaluation conducted by Proximal; 1M context, max effort, 128K maximum output tokens; Dominance score as of 2026-08-14; developer-reported | Benchmark; Footnotes |
| FrontierSWE | Claude Opus 4.8 | 66.5% | evaluation conducted by Proximal; 1M context, max effort, 128K maximum output tokens; Dominance score as of 2026-08-14; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| FrontierSWE | Claude Fable 5 (w/ fallback) | 88.2% | evaluation conducted by Proximal; 1M context, max effort, 128K maximum output tokens; Dominance score as of 2026-08-14; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | GLM-5.3 | 42.5% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; developer-reported | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | GLM-5.2 | 19.4% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; developer-reported | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | Kimi K3 | 48.1% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | Claude Opus 4.8 | 48.8% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | Claude Fable 5 (w/ fallback) | 33.1% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| SWE-Marathon (v1.1) | GPT-5.6 Sol | 42.5% | Claude Code 2.1.207, maximum effort, temperature 1.0, top_p 0.95, max_new_tokens 128,000, 1M context; anti-cheat checks for strip-clone replaced by LLM-based inspection; Docker build fix for parameter-golf and trimul-cuda; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| PostTrainBench | GLM-5.3 | 39.8% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; developer-reported | Benchmark; Footnotes |
| PostTrainBench | GLM-5.2 | 31.7% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; developer-reported | Benchmark; Footnotes |
| PostTrainBench | Kimi K3 | 32.0% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| PostTrainBench | Claude Opus 4.8 | 32.9% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| PostTrainBench | Claude Fable 5 (w/ fallback) | 41.8% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| PostTrainBench | GPT-5.6 Sol | 36.2% | Claude Code 2.1.207, max effort, temperature 1.0, top_p 1.0, max_new_tokens 128,000, 1M context; weighted average over 3 runs; failed runs fall back to the official zero-shot base-model baseline; external-API check done by an LLM agent instead of pattern matching; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | GLM-5.3 | 73.0% | official evaluation service; pass@1 averaged over 3 independent runs; developer-reported | Benchmark; Footnotes |
| Toolathlon Verified | GLM-5.2 | 59.9% | official evaluation service; pass@1 averaged over 3 independent runs; developer-reported | Benchmark; Footnotes |
| Toolathlon Verified | Kimi K3 | 76.5% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | DeepSeek-V4 Pro-0813 | 74.1% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | Qwen3.8-Max | 72.5% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | Claude Opus 4.8 | 76.2% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | Claude Fable 5 (w/ fallback) | 74.7% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Toolathlon Verified | GPT-5.6 Sol | 74.9% | official evaluation service; pass@1 averaged over 3 independent runs; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | GLM-5.3 | 48.2% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); developer-reported | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | GLM-5.2 | 26.2% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); developer-reported | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | Kimi K3 | 46.7% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | DeepSeek-V4 Pro-0813 | 43.2% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | Qwen3.8-Max | 39.8% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | Claude Opus 4.8 | 41.0% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | Claude Fable 5 (w/ fallback) | 46.2% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| AutomationBench (v1.0.6) | GPT-5.6 Sol | 45.8% | AutomationBench v1.0.6 including the fix for null-type handling (PR #13); reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | GLM-5.3 | 28.5% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; developer-reported | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | GLM-5.2 | 23.8% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; developer-reported | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | Kimi K3 | 27.6% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | DeepSeek-V4 Pro-0813 | 25.7% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | Qwen3.8-Max | 27.0% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | Claude Opus 4.8 | 25.7% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | Claude Fable 5 (w/ fallback) | 23.8% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Agents' Last Exam (ALE-CLI) | GPT-5.6 Sol | 28.6% | official ALE protocol with the Claude Code harness, reasoning effort max, 1M context, 64K maximum output; 105 tasks in isolated Docker containers; default 4-hour timeout (task-specific limits up to 8 hours); Tool Search disabled; official ALE evaluators; reported by Z.ai (Zhipu AI) in the GLM-5.3 model card | Benchmark; Footnotes |
| Z.ai Code Bench | GLM-5.3 | 50% improvement over GLM-5.2 | in-house benchmark; relative improvement only, no absolute score given; developer-reported | Introduction |
Provenance
The raw file is the verbatim README fetched from Hugging Face on September 19, 2026; the repository was last modified on September 4, 2026. A benchmark chart embedded as an image is not reproduced. The results are developer-reported or relayed by the developer, which is the basis for the medium confidence rating. The same table appears in Z.ai's launch post (Source: z.ai). The companion card for GLM-5.3-Flash gives evaluation footnotes but presents its results only as an image (Source: huggingface.co).
Relationships
- supports: GLM-5.3 — primary reference for the model's reported benchmark results.
- depends-on: GLM-5.3 License — the licence the weights were released under; GLM-5: from Vibe Coding to Agentic Engineering (Zhipu AI, 2026) — the technical report the card cites.
- related: GLM-5.2 Model Card (Z.ai, June 2026), CyberGym, ExploitGym, ExploitBench, Zhipu AI