South Africa's AI Policy Cited Fake Sources. The White House Is Killing Real Ones.

South Africa withdrew its draft national AI policy last week after it emerged that the document cited sources that don't exist — fabricated references generated by the same technology the policy was meant to govern.[¹] The story spread quickly, mostly as dark comedy: the government had used AI to write its AI rules and hadn't noticed the hallucinations until journalists did. But the joke points at something grimmer. If the agencies responsible for building regulatory frameworks can't critically evaluate AI output in their own drafting process, the credibility problem in AI regulation isn't just political — it's epistemic.

The same week, a report surfaced that the White House has been quietly pressuring Republican-led state legislatures to kill or water down their own AI bills.[²] "I am disappointed that states are being told to wait to address this critical issue," one GOP state senator said — a rare break from party discipline that signals how far the pressure has traveled. The dynamic is familiar from earlier tech policy fights: federal actors invoke the threat of regulatory fragmentation to justify preempting local action, while offering nothing concrete at the national level to fill the gap. The vacuum left by the rollback of Biden's AI executive order made state-level experimentation feel necessary; now that experimentation is being shut down before it produces results.

What's striking about both stories is that they're not really about AI capability at all. South Africa's policy failure wasn't a technical problem — it was a governance culture that trusted AI output without verification, in precisely the domain where verification is the job. The White House pressure campaign isn't about whether state AI bills are good or bad law; it's about who controls the timeline. Neither story involves a model doing something unexpected. Both involve humans making choices that are entirely legible, and those choices are producing a regulatory environment that is less accountable than the one that existed before anyone started writing AI laws.

The geopolitical dimension of this is becoming harder to ignore. The UK quietly shelved its promised AI bill after aligning itself with Washington's lighter-touch posture, a move that Keir Starmer's government has not meaningfully defended in public.[³] The EU's AI Act, meanwhile, is generating a cottage industry of compliance education — an Austrian university launched a MOOC on it this week — without any clarity on whether its enforcement architecture can survive contact with American firms that face no equivalent domestic pressure. Governments everywhere are writing AI rules; the question of whether any of them will be enforced is still unanswered, and the answer is looking increasingly like no.

The South Africa story is already being processed as a cautionary tale about AI misuse. It will probably be cited in future policy debates as evidence for why human oversight matters. That's fine, as far as it goes. But the more durable lesson is about institutional incentives: the same governments that face pressure to appear technologically forward-leaning are also the ones being asked to regulate an industry that funds the political conditions of their own survival. The money that resists AI regulation doesn't hide — it runs attack ads. A draft policy that cites phantom sources at least had the decency to be visibly wrong.