logoalt Hacker News

p1esktoday at 8:44 PM0 repliesview on HN

Is there any degradation with INT8 weights quantization? Why would anyone want to apply ConvRot to do 8 bit weights? Note the paper [1] focuses on 4 bit weights and 4 bit activations (W4A4) quant scheme - a much more challenging goal. My understanding is that W8A8 with weights quantized per-output-channel is a solved problem - does not need any fancy methods like GPTQ, SpinQuant etc.

[1] https://arxiv.org/abs/2512.03673