logoalt Hacker News

throw10920 • yesterday at 5:10 PM • 0 replies • view on HN

"2-bit quant" is the "in mice" of "look at how big a model I can fit on this hardware".