logoalt Hacker News

speedgoosetoday at 6:17 AM0 repliesview on HN

Yes I agree that at full speed with parallel workloads, the tokens per watt are better using Nvidia GPU servers.

Also while the pre fill performance sucks, the Mac isn’t that slow and can use much better model compared to a similarly priced Nvidia workstation so it’s not really taking much longer in practice.

It’s taking longer than in the cloud for sure. At least a local computer uses the local energy grid that is pretty clean and not fossil energy.