Power Is the Constraint. Investment Keeps Accelerating Anyway.

Someone put it plainly in a post circulating among infrastructure observers this week: "Power is the constraint, yet investment accelerates, widening the gap between announced capacity and what can actually be delivered."[¹] It's not a prediction. It reads like a description of the industry's current operating posture — build first, figure out the grid later. The AI hardware conversation rarely produces a cleaner summary of its own central tension than that.

Google's announcements at Cloud Next 2026 sharpened the picture. The company unveiled two new TPU chips — one for training, one for inference — explicitly framed for what it called the "agentic era."[²] The split is telling: Google is now designing silicon around the assumption that inference workloads will be continuous, persistent, and distinct enough from training to require their own dedicated hardware. Whether that framing proves correct matters less right now than what it signals about where the industry believes compute demand is heading. Up, and bifurcated. Meanwhile, the agent infrastructure argument is still unsettled — the hardware is being built for a deployment pattern that hasn't fully arrived.

The week's most concrete data point came from a deal that landed with minimal fanfare: Mira Murati's Thinking Machines Lab signed a multibillion-dollar agreement with Google Cloud, with the infrastructure running on Nvidia's latest GB300 chips.[³] Murati left OpenAI last year and has since been relatively quiet about what she's building. A commitment at that scale — for GB300s, which aren't yet widely deployed — tells you something about both the ambition of the project and the competition among cloud providers to lock in promising labs before they become obvious clients. Nvidia wins either way; its chips are the substrate of every major deal regardless of which cloud wins the contract.

One thread that keeps surfacing without quite becoming a story is the sovereignty argument. Several voices this week, none with significant engagement individually, circulated variants of the same idea: that running AI on your own hardware, without cloud dependency, constitutes a meaningful form of autonomy. The phrase "device sovereignty" appeared in multiple posts with no apparent coordination. It's a framing that lives mostly in infrastructure circles right now, but it maps cleanly onto a larger geopolitical anxiety — about who controls the compute layer and what that control enables. The geopolitical dimension of Nvidia's dominance has been building for months. The UAE's newly granted access to advanced chips,[⁴] noted this week in passing, is the clearest sign that AI hardware has become a foreign policy instrument as much as a technology product.

The efficiency argument is the one gaining the most traction underneath all of this. Nvidia researchers publishing the claim that efficient LLMs may eventually replace agentic AI pipelines[⁵] is not a casual observation — it's a company with enormous incentive to sell more compute arguing that the industry might not need to buy as much. The research finding that LLMs don't use all their attention layers,[⁶] circulating in technical news this week, points the same direction: the models the industry is building infrastructure for may be significantly over-engineered for what they actually do. One observer put it as a question worth sitting with — whether an incoming energy crisis might shift emphasis from absolute compute toward efficiency per unit of AI performance.[⁷] That question hasn't reached the investment level yet. But the research is starting to accumulate, and at some point the gap between what the hardware industry is promising and what the models actually require becomes a story the market can't ignore.