Local models are already useful today. The next milestone is getting this level of performance onto truly affordable hardware.
NVidia has less than zero reason to ship cards ideal for this at low prices.
AMD’s stock price reflects a hope they launch a CUDA alternative. But this is unlikely for the near future.
There is a lot of interest in preventing China coming in with cheap AI hardware.
So I expect the direction to be good local models that few can run effectively.
NVidia has less than zero reason to ship cards ideal for this at low prices.
AMD’s stock price reflects a hope they launch a CUDA alternative. But this is unlikely for the near future.
There is a lot of interest in preventing China coming in with cheap AI hardware.
So I expect the direction to be good local models that few can run effectively.