alt Hacker NewsRight now, the "economic model" of AI is "who has the best model", or really weights.
That'll go away eventually, just like operating systems eventually became free.
Instead, it's going to come down to selling inference hardware. We'll likely see the "apple" model where a custom OS runs on their hardware, but we'll probably also see more things like Cerebras become commodity hardware instead of kilowatt-class datacenter only hardware.
> we'll probably also see more things like Cerebras become commodity hardware instead of kilowatt-class datacenter only hardware.
Cerebras uses a unreal amount of SRAM to make these dies feasible. If AI weights become small enough to fit into commodity-scale Cerebras chips like that, you might as well load it into unified memory instead and run inference on a GPGPU-capable SOC instead. CUDA-style acceleration makes much more sense at that scale, especially if your use-case is just realtime conversational AI on a smartphone.