They are in Nvidia warehouses. Nvidia is selling H100s and other hardware in advance to firms who do not have data centres to put them in.
Nobody is getting fired for thinking they need to buy scarce H100s in case they aren't able to get them in the future. Nobody is even getting fired for keeping their companies out of Jensen Jail — the fear that if they don't buy the whole server stack from Nvidia they might not get future GPU allocations.
There really are analysts who think Nvidia is channel-stuffing.
If the market deflates there will be a glut of very cheap compute, both in terms of data centres (though many of them will be able to offer managed model training services instead, I suspect) and in terms of unused hardware being made available for sale.
alt Hacker News
They are in Nvidia warehouses. Nvidia is selling H100s and other hardware in advance to firms who do not have data centres to put them in.
Nobody is getting fired for thinking they need to buy scarce H100s in case they aren't able to get them in the future. Nobody is even getting fired for keeping their companies out of Jensen Jail — the fear that if they don't buy the whole server stack from Nvidia they might not get future GPU allocations.
There really are analysts who think Nvidia is channel-stuffing.
If the market deflates there will be a glut of very cheap compute, both in terms of data centres (though many of them will be able to offer managed model training services instead, I suspect) and in terms of unused hardware being made available for sale.
Nvidia won't lose out; everyone else is going to.