logoalt Hacker News

bryanlarsen • yesterday at 7:30 PM • 0 replies • view on HN

everybody and their dog are designing inference chips. Even currently, Google's Tensor can do inference cheaper and more efficiently than a B200. There are dozens of companies designing inference chips; when they hit the market the pricing power of B200 will drop significantly.

And it's correlated with the other bubble dropping because chip cost will matter a lot more once the margin of tokens is tight.