AI in Healthcare Is Fighting on Three Fronts Simultaneously — and Losing One of Them Badly

Google launched a feature that crowdsourced amateur medical advice through its AI search, then scrapped it — and the fact that this required a quiet removal rather than a confident pivot tells you almost everything about where consumer-facing healthcare AI actually stands. The Guardian covered the burial; Bluesky noted it without much surprise. The mood wasn't outrage so much as a kind of tired vindication, the feeling of people who had already written that exact sentence in their heads.

That fatalism is doing something real in the conversation. Posts about AI's healthcare potential — the NVIDIA robotics dataset, the Viva Biotech drug discovery partnership out of Shanghai — exist in a completely separate register of discussion from posts about what AI is actually doing to patients right now. The drug discovery crowd talks about infrastructure, foundation models, the long game of compound development. Everyone else is talking about a person with Type 1 diabetes who spent six weeks entering insulin and glucose readings into an AI tool because it promised to generate a shareable spreadsheet for their doctor — and then found out the data retention terms meant something different than they'd understood. These two conversations don't really speak to each other, and they're not trying to.

The insurance and billing fight is where the stakes get most concrete. U.S. hospitals and insurers have been locked in a decades-long war over claims and reimbursements, and both sides are now arming themselves with AI — insurers to deny faster, providers to appeal faster. What's interesting isn't that this is happening; it's that nobody seems particularly alarmed by the automation of a system that was already failing patients before any algorithm touched it. The framing in most coverage treats AI adoption here as a neutral efficiency story. The Bluesky posts about it don't.

The fake doctor problem is less discussed but arguably more urgent in terms of near-term harm. TVO's *Big, If True* documented it this week: AI-generated "doctors" operating across social media platforms, selling supplements and health regimens to audiences who've lost trust in institutional medicine and are looking for alternatives. The people most vulnerable to this aren't naive — they're often deeply informed about their conditions, frustrated by a healthcare system that's dismissed them, and being targeted precisely because of that combination. AI didn't create health misinformation, but it has industrialized the production of credible-sounding health personalities at a cost approaching zero.

What the clinical research community is grappling with quietly is the adaptation problem — a paper in *Nature Medicine* this month flags that fine-tuning medical AI models for new clinical settings often strips away the contextual understanding that made them useful in the first place. This isn't a headline story yet, but it's the kind of finding that tends to arrive as a warning well before it arrives as a scandal. The gap between a model that performs well in a controlled research setting and one that performs well in a community clinic in a different health system turns out to be large, poorly mapped, and not really anyone's specific job to close. By the time it becomes someone's job, it'll be because something went wrong.