logoalt Hacker News

drdaeman • yesterday at 9:39 PM • 1 reply • view on HN

Rather than waiting, ask your assistant to quantize for you. It could be not the best quantization possible but it’s relatively quick, and I had an overall positive experience.


Replies

smallerize • yesterday at 9:54 PM

It is already quantized. You need to convert to GGUF format though. Did your assistant explain this wrong?

➕ show 1 reply