The Frontier

vivo's 3B on-device model tops phone LLM chart, nears cloud scores

A SuperCLUE benchmark released Friday found that a small model living entirely on a phone is competitive with the cloud. vivo's BlueLM 3.5 Nano 3B took the top spot on the group's on-device leaderboard with 89.86 points, edging past the field while scoring within a small margin of flagship cloud systems it wasn't even competing against.

vivo's on-device BlueLM 3B topped SuperCLUE's phone-LLM chart — and nearly matched the big cloud models. The 3.5 Nano scored 89.86 in SuperCLUE's OnDevice run, the highest among phone-local models. Cloud models were listed only as reference points and didn't rank: Google's Gemini 3.6 Flash hit 93.64, ByteDance's Doubao Seed 2.1 Pro scored 92.99, and Alibaba's Qwen3.8 Max landed at 92.25. Behind vivo on the device table sat Qwen3.5 9B at 87.82 and Qwen3.5 4B at 85.16, with GLM 4.6V Flash, Gemma 4 E4B, and Gemma 4 E2B further down.

What makes the result notable is how small the winning model is. On-device models have long been written off as a significant step below cloud quality, held back by phone hardware limits on parameter count. A single 3B model coming this close to a frontier cloud model — roughly a 4-point gap to Gemini 3.6 Flash — suggests the "you need a huge model" assumption is weaker than it looked. The tradeoff is real, though: a 3B model still hits a ceiling on the hardest tasks, and one benchmark run isn't proof of everyday performance across apps and system tuning. But the privacy win is structural — everything runs and stays on the handset, with no upload, which is exactly where on-device AI is heading as images and text-heavy assistants eat into the phone's weekly compute budget.

What to watch

Whether the gap narrows further as phone vendors race to optimize for these leaderboards — and whether a genuinely offline assistant becomes a default phone feature, not a Telephony-flavored extra.

Does a 90-point on-device model make you want your next AI assistant purely offline, or do you still trust the cloud more? Tell us in the comments.

Sources: 快科技 (via Sina) · Sina Finance mobile · SuperCLUE · Reddit r/Vivo discussion

Study: frontier AI labs lack real rogue-model containment plans

Five leading frontier labs have few publicly documented, concrete plans for what happens if one of their models escapes human control, according to a new assessment from Guidelight AI Standards — and the findings land as regulators in California and New York begin forcing disclosure of exactly this kind of safety

The Take — Sutton is right that frozen AI has a ceiling

Richard Sutton, the reinforcement-learning pioneer who wrote "The Bitter Lesson," is one of the few people in AI whose contrarianism is worth taking seriously. But his most cited claim this week isn't his strongest. He is wrong to call synthetic data the industry's

Hollywood creatives are paid to train the AI that may replace them

Award-winning writers, directors and producers are quietly taking gig work that trains AI models to do their own jobs, according to a Guardian investigation published today. It's the sharpest portrait yet of the invisible hiring boom behind frontier labs — and the people powering it are often the

MCP's hardest problem: proving which agent asked for what

The Model Context Protocol — the open standard that lets AI assistants plug into tools and data sources, the plumbing under nearly every agent you've met — published a fresh roadmap on Friday. Across its five priority areas, one stands out less for its novelty than for how long it

What to watch

Read more

Study: frontier AI labs lack real rogue-model containment plans

The Take — Sutton is right that frozen AI has a ceiling

Hollywood creatives are paid to train the AI that may replace them

MCP's hardest problem: proving which agent asked for what