logoalt Hacker News

porridgeraisintoday at 4:04 AM0 repliesview on HN

They have managed to make the external link 300GBps/2us. Cs3 was 150/5.

This is 1/3rd blackwells nvlink c2c bandwidth already. Not too bad. We can make KV cache offload work with that I suppose.

If magically KV cache was not an issue, pipeline parallelism on cerebras can be quite pleasant. As for the KV cache offload, I have hopes their CPO solution they're trying with that canadian company ends up bearing fruit.