logoalt Hacker News

scosmantoday at 1:22 AM0 repliesview on HN

Google's QAT claims to need 6.7 GB RAM, vs Unsloth's dynamic quants at 8GB. Would love to see some benchmarks. Both amazing for size.