No, for a dollar of inference sold, (as an average of all the different inference tiers and plans), it cost them 15c to provide it.
This excludes the R&D costs, including training, where most of their costs lie.
The basic truth of LLM economics is that inference is cheap. The NRE cost to get where you can get premium prices for inference is sky-high. This is part of why the AI companies want to drive the scale up so much.
alt Hacker News
No, for a dollar of inference sold, (as an average of all the different inference tiers and plans), it cost them 15c to provide it.
This excludes the R&D costs, including training, where most of their costs lie.
The basic truth of LLM economics is that inference is cheap. The NRE cost to get where you can get premium prices for inference is sky-high. This is part of why the AI companies want to drive the scale up so much.