alt Hacker NewsFive years from now, I don't know why anyone will still be using Nvidia for inference. Note that Cerebras is for inference only, not for training.
I understand that Cerebras has competition, but this bodes even more poorly for Nvidia for inference. Nvidia may still have a role to play for training, however.
Replies
kcb • today at 4:06 AM
Nvidia is at this time a pretty well run company tech wise. They are going to keep iterating on the inferencing hardware stack over the next five years too.
wmf • today at 1:48 AM
Cerebras is only claiming ~2x the performance of Groqvidia which usually isn't enough for people to switch.
NVIDIA has the best supply chain in the entire game. They are the only ones who can produce at their scale. You really shouldn’t underestimate their position