alt Hacker Newsthere are roughly three of them and they all use the same pricing model. I am also not in the position to build a frontier model company these days.
Replies
hn_throwaway_99 • yesterday at 7:59 PM
A per-token model roughly aligns with the providers' costs, and it is an objective measure, so it seems a reasonable way to charge.
I see posts all the time on HN about which models from which providers offer the most bang-for-the-buck, and how to minimize token usage and still get optimal results, so it appears that competition is working.
surgical_fire • yesterday at 7:09 PM
There are more than 3.
Hell, I use 3 different providers, and I currently don't give a dime to Anthropic or OpenAI.
You could try:
1. Self hosting
2. Chinese models
3. Running it locally. Requires upfront cost and compromises on TPS.