> You can’t show ROI to investors by cutting inference costs

You can as long as you can saturate hardware with profit that makes up for training costs (which are also in free fall).

Anthropic is most at risk since they haven't bought any hardware (afaik), however OpenAi is building custom silicon now. The rest of Mag7 are primarily hardware vendors