Fudan's Whitzard agent ranks No. 2 on CyberGym exploit benchmark

Share
Fudan's Whitzard agent ranks No. 2 on CyberGym exploit benchmark

A Chinese university team just proved that an open-weight model plus strong agent scaffolding can out-hack the labs that built the models.

Fudan University's Whitzard agent jumped to No. 2 globally — and No. 1 among universities — on CyberGym, the AI security benchmark, cracking 91.2% of the real-world vulnerabilities it faced. The new leaderboard, released this week, puts the team led by Professor Yang Min's lab in the world's first tier of AI attack-and-defense research. CyberGym, initiated by UC Berkeley, is one of the harsher tests in AI security: agents are dropped into full repositories of millions of lines of code drawn from 188 large open-source projects and must autonomously locate, analyze, and exploit real vulnerabilities, then verify the attack in a sandbox. No multiple choice — either the code breaks or it doesn't.

The jump is the story. Whitzard's previous phase score was 68.9%; the new version hit 91.2% — cracking 1,374 of the benchmark's 1,507 vulnerabilities — after iterating on long-horizon reasoning and dynamic verification, and after switching its engine to DeepSeek-v4-Flash, an open-weight model. That result beats DeepSeek's own official CyberGym entry by 14.5%, which makes the point neatly: in hard, real-world tasks, agent design and model choice matter as much as raw scale. The Fudan group — the only Chinese team holding a "grand slam" of distinguished paper awards at the four top cybersecurity conferences — is turning a decade of academic work into working attack agents.

Why it matters: this is offensive capability, not a trivia benchmark. An agent that autonomously finds and exploits real vulnerabilities in production-scale codebases is exactly the dual-use capability safety researchers keep flagging — the same theme as Zhipu's GLM-5.3 shipping with "emergent" cyber tools earlier this week, which we covered in Zhipu's GLM-5.3 ships with 'emergent' cyber capabilities. When a university team out-hacks the model makers using their own open weights, the "we'll gate the dangerous capabilities ourselves" argument gets harder to sell — to regulators and to the labs.

What to watch: whether the model-vs-scaffolding split holds as bigger labs pour more compute into their own agents, and who eventually claims the No. 1 slot on CyberGym.

If a university-built agent can out-exploit the labs that trained the models, who should control AI security research? Tell us in the comments.

Read more

Byteification turns Qwen3 and Llama 3 into byte-level models

Byteification turns Qwen3 and Llama 3 into byte-level models

The tokenizer is the last piece of the language-model pipeline that was never learned end to end — and a Nature paper out this week shows it can be swapped out for less than one percent of a pretraining budget. Researchers have retrofitted four open subword language models into true byte-level models using less than 1% of a typical pretraining budget, and the result — published 7 October in Nature — closes the performance gap that has kept byte-level models a niche curiosity for nearly a decad

OpenAI's dots go mobile and can start your Codex work

OpenAI's dots go mobile and can start your Codex work

One product update and two benchmark papers this hour, all circling the same question: how much of the work can you actually hand over, and what happens to the part you didn't? OpenAI's dots — the always-on agents that get their own cloud computer — can now be created and configured entirely from the ChatGPT app on iOS and Android, and a dot can start Codex work or pick up an existing Codex thread on your behalf. The October 9 release, billed as the first of a fresh run of updates for dots, mo

Coding agents as a hospital: Cockroach's five-month results

Coding agents as a hospital: Cockroach's five-month results

The agentic-coding debate keeps being framed as speed versus trust. Cockroach Labs just published the most detailed trust-first ledger yet — five months of numbers, including the parts that didn't work. Cockroach Labs ran its codebase like a teaching hospital for five months and says the pipeline merged well over a million lines of code with seven total reverts. In the setup the company calls MOLT Sinai, GitHub issues are patients, merging is discharge, and the humans in charge are Chiefs of M

Today in AI — October 10, 2026

Today in AI — October 10, 2026

A day where the boring machinery took center stage: proof checkers, order books, warehouses and the humble text message — plus fresh arguments about who gets to declare any of it safe. Models & Research * Mathematicians get a reliability primer for the Lean Theorem Prover. A guest post by Thomas Hales on Terence Tao's blog walks through what Lean actually guarantees — and devotes itself to the "Summer of Soundness Bugs," the string of kernel bugs found this summer that let false proofs thr