logoalt Hacker News

jeffreyrogersyesterday at 7:29 PM4 repliesview on HN

> free and low-end eventually wins

Not in SaaS which is what LLMs are. You can get VMs for much cheaper than AWS, Microsoft, and Google offer them but large companies (and startups) are happy to pay a premium for the support, reputation, and reliability that they perceive those companies as offering. Same thing for some of the managed database providers who are effectively selling a very heavily marked up version of postgres.

> The high price, and social pushback, mean that the American companies producing these models are precarious

I doubt it. The models really aren't that expensive when you look at what they can do. Fable is probably at least as good as the average software engineer and costs $50/wk on the max plan vs a software engineer who would cost closer to $4000 a week. The real money is probably in selling to enterprise vs consumers (Google has best route to making money from consumers since they can do what they did with ads and search to LLM queries).

It seems unlikely to me that US companies will send important corporate data to models controlled by a Chinese company as well.


Replies

tomtheelderyesterday at 8:41 PM

> Fable is probably at least as good as the average software engineer and costs $50/wk on the max plan vs a software engineer who would cost closer to $4000 a week.

That's because the max plans are _massively_ subsidized. At API pricing the kind of usage to replace the value of a SWE is going to be way, WAY more than $50/wk. Orders of magnitude more. And to remain a frontier model org that kind of pricing has to continue in perpetuity.

ilovecake1984yesterday at 7:44 PM

There will always be a space for perforce in a world of git.

Doesn’t mean perforce is worth trillions.

show 1 reply
geophileyesterday at 8:08 PM

But aren’t the frontier models heavily subsidized? That’s not sustainable.

show 1 reply
jongjongyesterday at 10:57 PM

LLMs are not SaaS. Some LLM are delivered as SaaS. Anyone who has a machine big enough to run a frontier model can launch their own LLM SaaS tomorrow and it would be functionality indistinguishable from any other which is running a similar model...

Also, big companies can choose to run their own models on their own hardware and get better security and privacy as the data doesn't need to leave their own premises.

show 1 reply