alt Hacker NewsSome advice I got from another HN Mac user was to run local models in energy saver mode. You'll get slightly reduced tokens, but the laptop won't overheat and the fans won't go wild.
Replies
fragmede • today at 7:29 AM
Oh. I've been using an icepack under my laptop to keep mine cool. I'm watching it with llamatop to see if the GPU is actually active or not, aw activity monitor wasn't showing me what I wanted.
➕ show 1 reply
And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.