curious why the HF pill (on the right) always has inaccurate values
I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.
I noticed the same, and I wonder as well.
alt Hacker News
I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.