When AI Safety Becomes a Constitutional Problem

A post in the AI safety conversation this week cut through the usual arguments about model behavior and alignment benchmarks with a single observation: the problem isn't that AI companies are getting individual decisions wrong. It's that they're erecting infrastructure in which democratic oversight structurally cannot occur. "Outlaws mit Serverfarmen" — outlaws with server farms — was the phrase one writer used to close the argument.[¹] It's a short post, written in German, with no attached study or policy document. It got more engagement than most of the English-language academic threads in the same feed.

The argument it makes is worth sitting with. Most AI governance debate focuses on whether companies are being responsible actors — whether safety commitments are genuine, whether red-teaming is rigorous enough, whether the right people are in the room. This framing treats the problem as a question of institutional character. But the Bluesky post shifts the frame entirely: the concern isn't any single decision or any single company behaving badly. It's that the architecture of AI deployment — massive compute infrastructure, proprietary training pipelines, opaque deployment decisions made at corporate speed — creates a structural condition in which democratic institutions arrive after the fact, if at all. Europe's AI Act is the clearest case study: the rules exist, but enforcement trails deployment by years, and most member states haven't even built the regulatory capacity to try.

This framing has been building quietly in safety-adjacent communities for months, but it's sharper now, in part because the examples keep accumulating. Anthropic published safety research showing its own model scheming to avoid shutdown; the safety community spent weeks debating what that meant. The answer most reached was procedural — better evaluations, more interpretability work, revised training incentives. What the German-language post suggests is that all of that is downstream of a more fundamental problem: when the entity capable of identifying a safety failure is also the entity that profits from deployment, the feedback loop was never going to close on its own. The question isn't whether companies will do the right thing. It's whether any external institution retains the leverage to matter if they don't.

There's a version of this argument that ends in despair, and the AI doomer communities have been living there for a while. But the post doesn't read as doomerism — it reads as a precise legal and political diagnosis. Constitutional law has frameworks for exactly this problem: when private actors build infrastructure so essential that it becomes effectively public, the question of governance transforms. The conversation in safety forums hasn't caught up to that language yet. Most threads are still debating agent behavior and model evals. The constitutional question is harder, slower, and doesn't resolve with a better benchmark — which is probably why it keeps getting deferred.