logoalt Hacker News

tgtweak • today at 7:08 AM • 1 reply • view on HN

Citing full precision benchmarks then just going with 4 bit quants

Replies

IsTom • today at 9:31 AM

It's natively Q4.