Demoted, Breached, and Dismissed: AI Safety's Week in Miniature

Collin Burns lasted less than a week. The former Anthropic researcher had just started leading the Centre for AI Standards and Innovation — the federal body charged with actually implementing safety standards — when the Trump administration pushed him out.[¹] He was hired on a Monday and gone by Thursday. The speed of it has been read, in safety-adjacent corners of Bluesky, less as a personnel decision than as a statement of intent: there is no longer a person at the top of the US government's AI safety apparatus, and the administration didn't take long to ensure that was the case.

That story would be notable on its own. What made this week stranger is that it landed alongside a separate disclosure that Anthropic — the company Burns came from, the one whose entire brand identity rests on safety-first restraint — had a dangerous, deliberately unreleased model accessed without authorization.[²] Anthropic had built a system capable of enabling cyberattacks and, correctly, chosen not to release it. Then, within days of that decision, a small group got in anyway. A Bluesky commenter captured the mood precisely: "This is what AI safety actually looks like in practice — not perfect." The observation isn't damning so much as clarifying. Safety, even when taken seriously by the most safety-focused lab in the industry, is not a solved condition. It is a practice that fails.

Both of those stories fed into a pre-existing argument that a Substack piece had been making in AI safety circles — that alignment research is closer to speculative fiction than science. The piece had already been cutting through r/ControlProblem, a community that takes existential risk seriously enough to debate it at length but is also clear-eyed about the field's limitations. The breach at Anthropic and the defenestration of Burns didn't prove the Substack argument right, but they gave it new context. If the most careful lab can lose control of its most dangerous model in a week, and if the federal official tasked with building safety infrastructure can be removed before he unpacks, the gap between alignment theory and alignment practice looks less like a research problem and more like a governance one.

That governance gap is widening along geopolitical lines, too. The UK government is actively resisting alignment with EU AI rules, with one official briefed on the discussions describing Brussels as having "started from the position of alignment" — using the word in its regulatory rather than technical sense, but the double meaning felt intentional to people sharing the quote online.[³] Meanwhile, a one-line post in r/ControlProblem resurfaced the question of what humanity has actually chosen to pause when faced with dangerous technologies — a short list, offered without commentary, that landed harder than any argument. The community didn't need the argument spelled out. The list made it.

What ties these threads together is something this beat has been tracking for weeks: the safety conversation keeps splitting between the theoretical and the operational, and the operational keeps losing. A researcher vanishes from a federal post. A model gets accessed. A Substack argues the whole enterprise is storytelling. None of these is a catastrophic failure in the science-fiction sense that dominates safety rhetoric. All of them are the kind of mundane institutional erosion that tends to matter more. The question the field hasn't answered — and isn't close to answering — is whether safety culture can survive in an environment where the people trying to build it keep getting removed before they start.