This is wrong. Token costs for the same model rapidly collapse over a year. Hardware inflation is a thing but not bad enough to outweigh the massive impact of software optimizations.

Tokens billed at API prices are profitable for openAI and anthropic today and it only get more lucrative every month for them as their inference costs fall. If it weren’t for continuous massive training runs taking larger and larger capex, these companies would be massively profitable