logoalt Hacker News

codedokodetoday at 4:46 PM0 repliesview on HN

Usually 4-bit 200B model is better than 8-bit 90B. But if you go below 4 bits, I am not sure what is better.