alt Hacker News> But inference is unique because its performance scales with high memory throughput, and you can’t assemble that by wiring together off the shelf parts in a consumer form factor.
Nvidia outperforms Mac significantly on diffusion inference and many other forms. It’s not as simple as the current Mac chips are entirely better for this.
Replies
tell me what pc with an nvidia gpu can you buy with same memory and performance.
I never liked apple hardware, but they are now untouchable since their shift to own sillicon for home hardware.
But they're pretty fast and can have loads of RAM, which would be prohibitively expensive with Nvidia.
Do NVIDIA solutions also outperform the Apple M-series in performance per Watt?
Nvidia isn't selling one-off home computers afaik. But yes in terms of datacenter cloud usage Nvidia performs.
But where are you going to find an Nvidia GPU with 128+ GB of memory at an enthusiast-compatible price?