How about if they plateau but prices skyrocket? Most companies would pay but if you're not working for a company that does pay for it, what's the line beyhond which you'd think twice about paying for it yourself? 500? 1000? 1500?
Let's say they have already plateau. But hardware continues to get better, right? So tokens should go down in price, not up. Since they're already 50%+ on inference today, better hardware would allow them to generate more tokens for less money.
I would pay $500 to start, build stuff with it, then keep going up the tiers as the stuff I'm building makes money.
Why would price skyrocket?
Let's say they have already plateau. But hardware continues to get better, right? So tokens should go down in price, not up. Since they're already 50%+ on inference today, better hardware would allow them to generate more tokens for less money.
I would pay $500 to start, build stuff with it, then keep going up the tiers as the stuff I'm building makes money.