Science Isn't Debating AI Anymore. It's Deciding What Counts as Knowledge.

A Bluesky scholar — the kind who posts careful threads about methodology at 11pm — put it this way last week: human-authored papers are now citing sources that were AI-generated and factually wrong, and the error is invisible because it happened upstream, before the writing began. The final text looks clean. The foundations aren't. This is the specific anxiety driving academic communities right now, and it has very little to do with whether researchers are submitting AI-generated work under their own names. That debate already happened. This one is harder.

The phrase gaining traction in these circles is "diligence assistant" — the framing that AI tools serve human judgment rather than substitute for it. It's a careful rhetorical choice, and it's doing a lot of political work. On Bluesky, where a significant portion of the post-Twitter academic migration landed, the dominant position is that AI will become load-bearing infrastructure for peer review, especially in social science, and that this is an engineering problem rather than a crisis. Build better stress-testing tools, catch the bad outputs before publication, and the system holds. The optimism is genuine, but it assumes the inputs are sound. If working researchers are already pulling from AI-generated sources that hallucinated their way into the citation ecosystem, then peer review tools trained to catch "AI slop" are solving for the last failure mode, not the current one.

There's a secondary problem that's gotten less attention but may prove more consequential over time: top AI models perform substantially worse in languages other than English, and this is a finding with specific implications for how scientific knowledge gets produced and whose knowledge counts. AI-assisted research infrastructure that encodes existing linguistic hierarchies doesn't just disadvantage non-English-speaking researchers — it shapes which questions get asked rigorously and which get asked sloppily, and those effects compound across citation networks for decades.

What's actually being negotiated, underneath all of it, is auditability. Science's claim to credibility has always rested on the principle that knowledge can be traced — that you can follow the chain of inference backward and check the work. AI doesn't break that principle in any single dramatic way. It just makes the chain longer, harder to follow, and in places already frayed. The researchers who are genuinely worried aren't worried about fraud. They're worried about drift — the slow, distributed accumulation of small epistemic compromises that no one intended and no one can fully locate. That's the kind of problem that doesn't show up in integrity audits until it's already structural.