logoalt Hacker News

entrope • yesterday at 8:48 PM • 2 replies • view on HN

For most purposes, this seems reasonable? This looks like a single-height card, so fitting four of these in a workstation or server would give 512 GB RAM and 2 TB/s total bandwidth. That's pretty attractive for a lot of current LLMs, even if one wishes for 1 TB capacity at 5 TB/s bandwidth.


Replies

throwawayffffas • yesterday at 11:45 PM

If you are going down this path, MI350P and RTX PRO 6000 Blackwell is what you would want. A lot more compute a lot more vram bandwidth.

➕ show 2 replies
varispeed • yesterday at 10:26 PM

But there are already plenty of products for most purposes.