alt Hacker NewsI actually think a desktop makes sense if you want to run local LLMs. I have an M4 Max laptop left to me when I got laid off. It can run good-sized LLMs, but the system heats up, the fans blast off, and it rips through the battery in under an hour. I'd rather have a desktop set up as a private inference server that I could connect to remotely.
Replies
Desktop maybe, but Imac that costs more for the same specs of the mini you can shove in the drawer in a desk? I mean with the airspace taken up by an imac you only remotely connect to you could probably have two side by side stacks of I don't know, maybe 20 mac minis each? HPC territory.
Bingo, desktops are still king for actual raw processing. Apple laptops are great, but they're still just computers, given proper cooling and power they can perform even better.
But the iMacs only have the sans-adjective M-series processors. And is it really gonna have optimal thermals in that thin frame pressed against a big, bright high-res screen?
If you need to push performance you'd probably go for a Mac Studio, no? Or at least a Mini.