> tokens are near-free already
How long do you think that will last?
Am over 11 billion tokens this month on a subscription. In API usage its close to $5000 and there's still 13 days left in the month.
Eventually the music in musical chairs stops. Already many anecdotal reports of the always opaque limits being lowered across the board. On a gemini pro account for personal use I can use a weeks worth of Argon in about 20 minutes on agy in the last month.
ChatGPT Pro I can use the weekly limit in under 2 days, this is with significant context clearing and handoffs.
The cost to provide frontier models isn't cheap and it's entirely subsidised by a winner-takes-all mentality from investors which in all likelihood won't come about.
The cost halves every year so far. Current level of llm will get cheaper