Depends on compute capacity. If we become supply constrained on tokens, then prices will necessarily go up.
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
alt Hacker News
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.