logoalt Hacker News

hemkeshrtoday at 1:23 PM1 replyview on HN

Local models are already useful today. The next milestone is getting this level of performance onto truly affordable hardware.


Replies

SV_BubbleTimetoday at 2:20 PM

NVidia has less than zero reason to ship cards ideal for this at low prices.

AMD’s stock price reflects a hope they launch a CUDA alternative. But this is unlikely for the near future.

There is a lot of interest in preventing China coming in with cheap AI hardware.

So I expect the direction to be good local models that few can run effectively.

show 1 reply