logoalt Hacker News

leansenseiyesterday at 9:24 AM0 repliesview on HN

And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.