alt Hacker NewsI really hope the future is local models, because the idea that all companies will need to buy tokens from a handfull of tech companies to run their businesses or make their products is awful.
Replies
I think we will see good enough local models, excellent cloud models, and then simpler focused models embedded on silicon running on every small device.
Why only a handfull? There can be (maybe already are) hundreds of LLM API providers.
> the idea that all companies will need to buy tokens from a handfull of tech companies to run their businesses or make their products is awful.
To the leadership of these tech companies that actually is the dream. Sam Altman said the quiet part aloud recently: "From a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer, and being used maybe 5% of the time."
And it certainly fits into the neofeudal worldview of other relevant Big Tech leaders. Be it Peter "I no longer believe that freedom and democracy are compatible" Thiel, or unnamed bigwigs discussing if shock collars are effective to prevent their staff from revolting after a doomsday scenario [2].
We shall own nothing and rent everything, that is the mindset these people believe.
(And if you ask me: the AI IPOs are part of that strategy. Assuming OpenAI and Anthropic both IPO, they will get part of every American's and most other countries' pension funds... and when they collapse, a lot of that value will be gone. The initial investors into SpaceX, OAI and Anthropic all will have made their money and put it aside, and we will be left holding bags)
[1] https://www.ign.com/articles/openai-ceo-sam-altman-thinks-it...
[2] https://www.rte.ie/news/business/2025/0511/1512086-doomsday-...
> the idea that all companies will need to buy tokens from a handfull of tech companies to run their businesses or make their products
Did you somehow become incapable of doing things without models? Most of us have not.
I've been ripped (on this site) for making this prediction. While the frontier (i.e. The toughest problems) will always push the limits of available computing power, what typical people do with AI won't always be on the frontier, nor will what appears on the frontier necessarily be lucrative. The frontier used to be playing Chess, Atari, and Go. These were challenging and really advanced AI, but they didn't make a lot of money. Now a phone can do these things.
You're an example of this process. You used to require a frontier model running on a data centre. Algorithms improved and, perhaps, your hardware as well, but your requirements didn't go up. Now you can do what you need to do with local hardware. You're one AI user who might not need to send money to Anthropic going forward unless you find a new frontier application that interests you.
This is why I'm a little bearish when it comes to the valuation of the AI giants. Yes, there are some extremely lucrative things on the frontier right now but, in the future, people may shift a lot of what they're doing now to local hardware while new things on the frontier may not produce the kind of profits that will pay back trillions in debt. AI companies have bet big on themselves being able to constantly and perpetually find new applications, and also that those new applications will make money.