alt Hacker NewsTrue, but have other hyperscalers caught up to Google's AI data centers?: fully liquid cooled, torus networking(?), 100,000+ TPUs interconnected, etc.
Google is already on gen 8 of its TPUs and is certainly already working on the next version or two.
Does it really matter? Those are interesting technologies, but off-the-shelf computers with some good fans and HVAC cool just fine. Likewise, 10 gigabit networking is not particularly expensive these days. Google's stuff is better and may or may not be cheaper. But wherever we can buy off the shelf now works just fine.