logoalt Hacker News

jsnellyesterday at 5:58 PM0 repliesview on HN

Because they are >10x more power efficient.

If silicon were relatively abundant and power/DC space scarce, you'd get an order of magnitude more bang for the Watt by replacing the H100s with newer GPUs.

But nobody is doing that. Blackwells are being installed as additional capacity, not Hopper replacements.

So it is pretty clear that silicon is the primary bottleneck.