can confirm.

I dont' know why people spend huge money on these and Spark. The 5090 is running qwen 3.8 at 200+ tps!! That's 1-2 orders of magnitude faster.

The issue is that the moment you want to run the more capable models that will no longer fit in a single 5090's memory, performance falls off a cliff.

Both are probably single-token decode performance, which is reasonable to show. Otherwise agree RTX 5090 should shinebetter with NVFP4.

... or with llama.cpp with MTP.

[flagged]