You are missing the point. This is a technology demonstration on prototype hardware, and no one intends it to be seriously useful.

Their architecture has fundamental speed and efficiency advantages over GPUs or Cerebras. They expect to scale up to real LLMs by splitting a model layer-wise across several chips, which they can do without incurring any throughput penalty.

I’ve been using 1,000 t/s on a near frontier model for a month now. It’s very useful for agentic coding.

It does require new approaches for me personally since I get a lot less time to think or read its output.

I think you missed the point and don't understand / aren't considerate of SLM utility.

[dead]