logoalt Hacker News

woadwarrior01today at 10:43 AM0 repliesview on HN

> some providers will ride on the good reputation of some local model, selling you a terrible quant instead.

Quants in popular local inference apps (Ollama, LM Studio, etc) are the worst possible quants (RTN).