What runtime are you using with the 2x RTX Pro 6000 Blackwell machine? I have the same setup and tried DSv4 Flash on vLLM and ran into a ton of kernel bugs that don't seem to have been fixed yet.
This one works great. https://github.com/ormandj/sglang-deepseek-v4-flash-sm120
so..you guys have $20k+ rigs?
This one works great. https://github.com/ormandj/sglang-deepseek-v4-flash-sm120