logoalt Hacker News

foosterlast Sunday at 2:07 PM7 repliesview on HN

Where is your evidence of this "massive cost"? Inference is massively profitable for both anthropic and openai. Training is not.


Replies

kibwenlast Sunday at 2:17 PM

The evidence is that quotas exist, as seen here, and are low enough that people are hitting them regularly. When was the last time you hit your quota of Google searches? When was the last time you hit your quota of StackOverflow questions? When was the last time you hit your quota of YouTube videos? Any service will rate limit abuse, but if abuse is indistinguishable from regular use from the provider's perspective, that's not a good sign.

show 2 replies
weakfishlast Sunday at 2:43 PM

This article convinced me otherwise https://www.wheresyoured.at/the-subprime-ai-crisis-is-here/

show 1 reply
reppapyesterday at 11:49 AM

Inference cannot happen without training the model first, so the distinction is quite pointless.

scrolloplast Sunday at 2:17 PM

The majority of accounts are free - these are profitable?

IMO they need as many users before their IPO - then the changes will really begin.

quikoalast Sunday at 3:11 PM

Inference for API or subscriptions? There is a massive price difference between the two.

ares623yesterday at 4:14 AM

You're assuming they can just stop training. For the entirety of these companies' existence, they have done training. It is part of their price. They must keep pushing out better and better models. That's like saying Nvidia can just stop making new GPUs, they're obviously making so much money with their current models now.

wesammikhaillast Sunday at 2:11 PM

source?

show 1 reply