Inference costs absolutely did fall. And even more so when looking at intelligence it buys you.
eg compare say gpt 3.5 to latest deepseek. Both cheaper and more at more capable
but are you using less of them because they're cheaper, or are you using more of the more advanced models and running them harder?
but are you using less of them because they're cheaper, or are you using more of the more advanced models and running them harder?