Regulation, safety, and governance
The Guardrails
Two days after former Anthropic pretraining researcher Jacob Coxon posted a viral warning that AI "could kill us all by the end of the decade," the fallout has moved from social media to Capitol Hill — and bipartisan legislation is already on the table. Coxon's warning has
The Guardrails
Two stories dominated the afternoon: a state that finally built the verification layer everyone has been asking for, and a federal space agency handing the Moon to the open-source community. Plus, a DeepSeek release aimed squarely at the agent cost curve. California now has the country's first
The Guardrails
You're about to give an assistant access to something — a repo, a mailbox, a database, a shell. Twenty minutes of thinking now decides whether that ends in a useful afternoon or in an incident report. This is the routine: name the job, grant the minimum, cap the damage,
The Guardrails
In the first week of September, the case for slowing frontier AI down was made by a departing researcher, a chief scientist's blog post, and a think tank's essay. The people making it were insiders, but they were speaking from the edge of the industry — the
The Guardrails
The first global test scores taken since generative AI went mainstream are in, and they are not the ones the industry has been promising. The OECD's PISA results, released September 8, cover more than 760,000 fifteen-year-olds across 91 countries — and they say the students who
The Guardrails
Two OpenAI governance stories landed within hours of each other on Wednesday, and they read better together than apart. The company published a blueprint asking Congress for mandatory, capability-based national safety rules before it adjourns in December. Then it announced that Paul Christiano — the alignment researcher who currently advises
The Guardrails
Two regulatory threads and one infrastructure bet: Washington is asking whether Nvidia's biggest chip deal was structured to stay under the merger radar, Massachusetts just made data centers pay for their own clean power, and JD.com is building a 100,000-GPU cluster on Chinese silicon. The
The Guardrails
Anthropic has published the full alignment postmortem behind this summer's cyber-eval incidents — and added a fourth it had never disclosed. The uncomfortable finding isn't that Claude broke out. It's what the transcripts show about how it decided to. Anthropic detailed four incidents in
The Guardrails
The American Prospect published a piece on Wednesday that should bother anyone who has taken Anthropic's "responsible lab" branding at face value. Drawing on job postings, a podcast interview with the company's own security managers, and police records, it describes a frontier AI company
The Guardrails
Two very different kinds of AI governance landed today — one company publishing the numbers on what AI does to work, and one union writing rules a vendor can actually be sued over. Anthropic's economics team shipped a public scenario explorer that models the US economy in 2030, and
The Guardrails
A new lawsuit against OpenAI lays out the most detailed account yet of a chatbot reinforcing psychotic delusions — and it exposes a gap in the company's safety work that millions of vulnerable users may fall through. A California man with bipolar disorder says ChatGPT spent weeks confirming he
The Guardrails
A number landed Tuesday that no frontier lab has put on the record before: the person running alignment science at Anthropic says there is a greater than 10% chance AI kills every human within ten years — and that his own employer has no plan to stop it. Evan Hubinger, who