logoalt Hacker News

yieldcrvtoday at 4:32 AM0 repliesview on HN

impressive, we can get high tokens/s with 8B param models and doubling it with MTP