alt Hacker NewsI think hardware scarcity plays a part in inference margins. They would get squeezed super quickly if anyone who wanted could just build an inference cluster, but that's not currently the case.
Replies
mike_hearn • yesterday at 5:11 PM
Maybe but there are huge blocks of capacity about to be energized or handed over and the payment clock starts ticking immediately.
I would assume hardware production has been ramping up significantly and it's more of a temporary supply chain issue though. While it could last multiple years, that's certainly not long enough for the hyperscalers to get a return on investment. Obviously more complicated than this, but still... I'm not buying.
We're also starting to see efficiency gains, so we might meet halfway.