logoalt Hacker News

tomega2134 • yesterday at 7:19 PM • 0 replies • view on HN

"hosting GPUs for local llms" meaning pci-express bandwidth and memory bandwidth are not issues for them, and CPU features probably also don't make a difference.