alt Hacker News> and make inference cheap enough to eventually escape the red numbers
Besides training, we have no hard, externally audited numbers that say inference costs for SOTA models are truly sustainable. Do any OpenRouter providers have publicly audited financial numbers ?
We do know about the hardware needed for a given token speed. What that hardware costs, and electricity prices.
With that its easy calculations to get about the profit margins for a given price for a given model.