At current prices, and considering these OS Models' performance, investing in local inference sounds like a bad idea.
At current "proprietary inference company behavior," investing in local inference sounds like the exceedingly far more rational option.
Long term predictability ought to far outweigh a few more cycles of performance.
Current prices are insane but at this point I'm starting to feel like it's an existential issue. I'm not a US citizen. At any point the USA could come up with some arbitrary export controls. Not having a computer capable of running at least Qwen is starting to actually seem risky to me.
At least it's going to be usable as a very high end gaming PC.