Rather than waiting, ask your assistant to quantize for you. It could be not the best quantization possible but it’s relatively quick, and I had an overall positive experience.
It is already quantized. You need to convert to GGUF format though. Did your assistant explain this wrong?
It is already quantized. You need to convert to GGUF format though. Did your assistant explain this wrong?