alt Hacker NewsLlamscpp provides reasoning budget and message. You can use the message to redirect it.
Once you get the agent and message consistent,itll keep moving.
Llamscpp provides reasoning budget and message. You can use the message to redirect it.
Once you get the agent and message consistent,itll keep moving.
You can use any message you want, but the model was tested to react reasonably well to the specific token sequence of "\nConsidering the limited time by the user, I have to give the solution based on the thinking directly now.\n</think>.\n\n" (from a Alibaba paper, struggling to find it now)
Edit: arXiv:2505.09388 Qwen3 Technical Report