logoalt Hacker News

dist-epoch • yesterday at 9:42 PM • 0 replies • view on HN

Modern inference stacks use different GPUs for decode versus prefill. This is a GPU suitable for prefill.