I don't understand why the open source model providers don't also publish the quantized ve...

fuddle • last Thursday at 4:56 PM • 1 reply • view on HN

I don't understand why the open source model providers don't also publish the quantized version?

danielhanchen • last Thursday at 4:58 PM

They sometimes do! Qwen, Google etc do them!

alt Hacker News