logoalt Hacker News

agile-gift0262today at 9:41 AM1 replyview on HN

And what's the right way to use Gemma? Where can I find the correct template and settings if those aren't the ones provided by Google, Unsloth, and aren't built into llama.cpp? I discarded using Gemma 4 because it got into weird loops when tool calling


Replies

kzrdudetoday at 10:44 AM

Some weeks ago a new official Gemma 4 release was posted that corrected some of the chat template problems. So the official release files on hugging face should be the way to go.

show 1 reply