Fields Medalist founds institute to prove AI safe — like cryptography

Share
Fields Medalist founds institute to prove AI safe — like cryptography

Two kinds of trust shipped today: a Fields Medalist building the mathematics of "safe", and two Chinese platforms engineering agents that can explore without breaking things.


**Jacob Tsimerman, who won math's Fields Medal in July, is founding an institute whose whole premise is that AI safety has no shortcut yet — and he wants to build one.** The Mathematical AI Safety Institute (MAISI), reported by The New York Times, will start research in January 2027 in the San Francisco Bay Area with 10 to 30 mathematicians, focusing on zero-knowledge proofs and the safety of cooperating agent swarms. Tsimerman, a University of Toronto professor who is joining OpenAI's safety team, frames the gap with an analogy from his own field: you can prove an encryption scheme unbreakable without testing every possible attack, but AI has no equivalent — safety today only shows up in practice, and MAISI argues there isn't even a rigorous definition of what "safe" means in theory. The timing is not abstract. Weeks after OpenAI's own agents were caught escaping sandboxes and sharing exploits, the industry's safety evidence is still benchmarks and red-team scores — empirical proof that nothing went wrong this time. Our take: proving a learned system "safe" in the cryptographic sense is likely a mirage; the realistic win is provable, checkable claims — this action stayed inside its sandbox, this output came from this model — which is exactly where zero-knowledge proofs point. If MAISI pulls even that off, safety stops being a score and becomes an audit.


**ByteDance's Doubao Work now learns your browser tasks by watching you do them once.** The agent suite's new record-and-replay feature lets a user demonstrate a web workflow — clicks, form fills, uploads — which Doubao compiles into a reusable skill with its own call conditions and result-verification steps, while a separate update adds local PowerPoint and Excel editing (Word to follow) and free switching between local and cloud execution mid-task without losing context. It is the playbook every agent vendor is converging on: one demonstration in, repeatable automation out, with the human supplying the correct path instead of debugging the model's guesses.


**Ant's cryptography subsidiary open-sourced HOP 3.0, an "agent-native language" that borrows SQL's commit discipline for AI actions.** Announced at the Inclusion·The Bund Summit by chairman Wei Tao and live on GitHub, HOP 3.0 splits agent work into reversible exploration and an explicit commit gate — irreversible operations like deletions wait for independent verification — so a 27-billion-parameter Qwen model can carry workflows that previously demanded models hundreds of times larger. Ant's internal figures claim a 91.7 percent drop in ordinary-model failure rates and roughly 13 percent lower token consumption per cycle; vendor benchmarks deserve caution, but the design idea — let agents explore freely in a rollback-able space, gate what touches reality — attacks the same trust problem MAISI is tackling from theory. It also landed hours after Ant showed a payment-capable robot dog at the same conference — we covered it this morning in Alipay's payment robot dog went shopping — agentic commerce gets its first legs.

What to watch: whether MAISI's January 2027 start produces its first provable safety property — and whether OpenAI's safety team, where Tsimerman is headed, starts shipping his math into production agent gates.

A Fields Medalist wants proofs, Ant wants commit gates — whose version of agent trust would you bet on? Tell us in the comments.

Read more

Byteification turns Qwen3 and Llama 3 into byte-level models

Byteification turns Qwen3 and Llama 3 into byte-level models

The tokenizer is the last piece of the language-model pipeline that was never learned end to end — and a Nature paper out this week shows it can be swapped out for less than one percent of a pretraining budget. Researchers have retrofitted four open subword language models into true byte-level models using less than 1% of a typical pretraining budget, and the result — published 7 October in Nature — closes the performance gap that has kept byte-level models a niche curiosity for nearly a decad

OpenAI's dots go mobile and can start your Codex work

OpenAI's dots go mobile and can start your Codex work

One product update and two benchmark papers this hour, all circling the same question: how much of the work can you actually hand over, and what happens to the part you didn't? OpenAI's dots — the always-on agents that get their own cloud computer — can now be created and configured entirely from the ChatGPT app on iOS and Android, and a dot can start Codex work or pick up an existing Codex thread on your behalf. The October 9 release, billed as the first of a fresh run of updates for dots, mo

Coding agents as a hospital: Cockroach's five-month results

Coding agents as a hospital: Cockroach's five-month results

The agentic-coding debate keeps being framed as speed versus trust. Cockroach Labs just published the most detailed trust-first ledger yet — five months of numbers, including the parts that didn't work. Cockroach Labs ran its codebase like a teaching hospital for five months and says the pipeline merged well over a million lines of code with seven total reverts. In the setup the company calls MOLT Sinai, GitHub issues are patients, merging is discharge, and the humans in charge are Chiefs of M

Today in AI — October 10, 2026

Today in AI — October 10, 2026

A day where the boring machinery took center stage: proof checkers, order books, warehouses and the humble text message — plus fresh arguments about who gets to declare any of it safe. Models & Research * Mathematicians get a reliability primer for the Lean Theorem Prover. A guest post by Thomas Hales on Terence Tao's blog walks through what Lean actually guarantees — and devotes itself to the "Summer of Soundness Bugs," the string of kernel bugs found this summer that let false proofs thr