logoalt Hacker News

austinthetacoyesterday at 3:05 PM1 replyview on HN

Have you played around with any of the Hermes models? they are supposed to be one of the best at non-refusal while keeping sane.


Replies

troadyesterday at 11:16 PM

Interesting! Unfortunately, the smallest Hermes 4 model I can see is 14B, which would really strain the limits of my little laptop. The only way I might get acceptable performance would be to run it extremely quantised, but then I probably wouldn't see much improvement over the 9B Qwen.