logoalt Hacker News

SwellJoeyesterday at 11:05 PM1 replyview on HN

I saw that one in the "Popular models" sort at Hugging Face and tried it on some tasks I do frequently to compare models, and it feels damaged by the fine-tune, to me. It wrote security bugs into the code (probably just sloppy thinking, not intentional), it exhibited looping behavior in some configurations in llama.cpp, configurations I regularly use with the regular 27B, and it failed to write unit tests without being prompted (though the regular Qwen 27B tends to do so if it sees there are unit tests for everything in the repo). They have good benchmarks, but I'm not going to trust it. Also, that name is absolutely crazy.


Replies

rablackburntoday at 2:40 AM

> but way, way better at creative writing than Qwen and even better than Gemma 4 26 and 31b.

I suspect this is the only use-case I would consider...and I don't really have a use-case for "creative writing" that I would delegate to an LLM. I suppose for dialogue generation in games?

But yes, hard agree. Why on Earth would you ever want to write code with a model that is supposedly "jailbroken"? So it can put great backdoors into everything it touches? Pass.

show 2 replies