>I think everyone has known that inference is profitable overall for the major providers for a while

Have you seen any place that is not as tech-savy as HN? e.g. some Reddit subreddits?

Barely anyone is aware other than people who are already somewhat deep into this whole topic.