alt Hacker NewsYou forgot to check the disk sapce - _M and _XL are not the same across quants:
Unsloth Q4_K_M 18.49GB 0.5478 KLD 99.9% 0.0192 mean
Unsloth Q4_K_XL 19.17GB 0.4097 KLD 99.9% 0.0137 mean
bartowski Q4_K_M 19.77GB 0.5771 KLD 99.9% 0.0182 mean
You forgot to check the disk sapce - _M and _XL are not the same across quants:
Unsloth Q4_K_M 18.49GB 0.5478 KLD 99.9% 0.0192 mean
Unsloth Q4_K_XL 19.17GB 0.4097 KLD 99.9% 0.0137 mean
bartowski Q4_K_M 19.77GB 0.5771 KLD 99.9% 0.0182 mean