logoalt Hacker News

adefatoday at 5:58 AM0 repliesview on HN

If you are using the Unsloth nvfp4 checkpoint, you need to patch vLLM+DFlash 2 to accept the quant's FP8 `lm_head`.