Frontier agents flunked two NeurIPS papers — graded by the authors
Two very different pictures of where agents actually are today: still failing at the top of AI research, and already handling real work inside a car cockpit and ByteDance's enterprise stack.
A new study turned frontier agents loose on two unpublished NeurIPS 2026 submissions, gave each six days and thousands of dollars of compute, then had the papers' original authors grade the output. The agents completed all of the engineering without human help and still could not make substantial progress on the research questions — both papers were rejected outright. The authors' post-mortem names five recurring failure modes: poor judgment about the bar for publishable research, uncreative responses when the research design ran into trouble, ineffective backtracking from dead ends, poor awareness of their own resource budget, and instruction drift. A second model and scaffold reproduced the same failures.
The method is the interesting part. Current evaluations either test narrow, verifiable tasks — which excludes open-ended research by construction — or submit AI-written papers to blind peer review, which the authors call overstretched and stochastic. Their alternative, "shadow evaluations," hands an agent the central question of a real unpublished paper and lets the people who wrote that paper judge the result. They released the expert reviews, survey responses, agent repositories and logs.
Read the conclusion carefully, because it is narrower than the headline circulating around it. The paper says today's agents can do the engineering of AI research but struggle with the research lifecycle. It does not claim autonomous self-improvement is impossible — the models tested were already a generation behind the frontier when the runs happened. We made a related argument earlier this week — An agent grading its own homework is an alibi, not proof — and this study is the same lesson from the other direction: capability shows up first in the parts of research that can be checked cheaply.
BYD and Alibaba Cloud put Qwen at the centre of the car's brain, launching a "super agent" cockpit rather than a better voice assistant. At its September 14 event, held alongside the all-electric Denza N8L launch, BYD showed an architecture where a cloud hub runs Qwen for intent recognition, task decomposition and service dispatch, then hands execution to separate agents for vehicle control, music, video, search and outside services. The cockpit can call Alibaba ecosystem services including Fliggy and Taobao Shangou, and BYD is opening an agent platform so third-party developers and AI agents can plug into the car. The pitch from BYD senior vice president Yang Dongsheng is orchestration, not conversation: the system is meant to finish a task — search, routing, booking — without the driver switching apps, and the two companies have been working together since 2023. Worth watching whether outside developers show up for a platform whose distribution depends on one automaker's fleet.
ByteDance's CEO said the company has merged Doubao, Feishu and Volcano Engine and will pour more resources into the enterprise market. Speaking at the Feishu Future Unlimited conference in Beijing, Liang Rubo argued that once agents become usable, the agent, the model and the collaboration environment have to fuse to be worth anything — which is why the three units were consolidated two months ago. His division of labour: Doubao Work supplies the intelligence, Feishu carries the company's context and tools, and Volcano Engine lets enterprises build their own agents on ByteDance models and compute, then wire them back into Feishu to work with people and other agents. It is a direct shot at Microsoft's Copilot stack, and it makes ByteDance an enterprise software vendor more than a consumer app company.
What to watch: whether shadow evaluations get adopted as a standing, re-run benchmark with each new model release — the authors' own suggestion is that the task, harness and budget stay frozen so only the model changes.
If a lab published an agent that reproduced your paper, would you believe the result before you read the code? Tell us in the comments.
Sources: arXiv — Can AI agents conduct open-ended AI research? · r/MachineLearning discussion · The Agent Report · Leiphone · MarkLines · cnevpost · Leiphone — ByteDance CEO on the Doubao/Feishu/Volcano integration · AIBase · XTech Pioneer
