
The Frontier
How to — tell a real benchmark from a marketing one
Every model launch ships a benchmark table. Almost every one of them is, in some sense, true. None of them are telling you the same thing. The job is not to find a fake benchmark — most aren't fake — but to find the one whose number you can carry into a decision. Here is the routine. Benchmarks are the scoreboard the field runs on, and the scoreboard is under strain. Terminal-Bench 4.0 spent recent releases removing saturated tasks and fixing broken ones; SWE-bench had to be split into a "Verif











