logoalt Hacker News

josh-wraletoday at 2:41 AM0 repliesview on HN

Yes, but I haven’t seen it in Unsloth/llama.cpp. I see it in Sglang and vllm. Unsloth should default to sglang imo