logoalt Hacker News

Schlagbohrer • today at 11:04 AM • 0 replies • view on HN

The top 3 repos sorted by stars on Huawei's github page are all for quantization. I am not an LLM scientist so I can't tell what the difference is between them, or why they need three different pipelines for model quantization.