logoalt Hacker News

wmf • yesterday at 6:08 PM • 1 reply • view on HN

Groq has been renamed to LPX and it's on the roadmap.


Replies

jpgvm • yesterday at 7:05 PM

Disclaimer: I was at Groq and now work at NVIDIA on LPX.

Specifically: https://www.nvidia.com/en-us/data-center/lpx/

We ran a pure-LPU demo for HotChips that AA benchmarked: https://developer.nvidia.com/blog/how-nvidia-groq-3-lpx-unlo...

TLDR: LPUs are very efficient, quite a lot more efficient and faster tok/s/u than anything else at this years Hot Chips.

It's my personal opinion that with the way models change you don't want silicon that is too specialised but it needs to be specialised enough. LPUs are designed to strike this balance such that they remain flexible if model architectures change drastically.

➕ show 3 replies