These are chips that become e-waste the second a better a model comes out, and nvidia is already limited by TSMC capacity.
They'll be perfect for an appliance like the Rick and Morty butter robot.
these aren’t made for general chatbot use
Only in VC backed funding land.
In the real world, theres talking refrigerators who dont need to know how to recite shakespeare.
This is a ridiculous mindset. Llama 3.1 8B can do lots of things today and it'll still be able to do those things tomorrow.
If you baked one of these into a smart speaker that could call tools to control lights and play music, it will still be able to do that when Llama 4 or 5 or 6 comes out.