alt Hacker NewsThat is wild. What if there is a huge break-through in LLM models where they can reduce compute by 90%? All of those data centers would suddenly crater (many customers cancel) and go bankrupt. I feel it could go either way.
Replies
Surely the thing the AI giants fear the most in this respect must be the possibility that competitive open models and locally available hardware reach the point of viability for most people. If that happens then where is the moat for the giants?
If progress with frontier models doesn't continue at the same pace then the investments and funny money deals might start to look very fragile.
If progress does continue then that progress might be towards smaller models more than quantum steps up in quality or capability that would increase the risk of the scenario above.
All of this is set against a backdrop of public hostility and political problems that I can only imagine increasing in the near term as well.
This feels like an unusually high stakes game of poker. I don't think I'd want to bet on Big AI right now if I had a few billion lying around. Then again - maybe that's why I don't have a few billion lying around!
That's already happened. It's one reason prices have dropped so much lately (n.b. in the quarter that's not in their S-1, I think!) They've been able to improve model efficiency a lot through better algorithms and training models to be less verbose.
Training costs haven’t plummeted like they have for inference afaik and the efficiencies are just translated into running larger and longer training. Basically Jevon’s paradox in action just like on the inference side.