logoalt Hacker News

gmueckl • today at 11:55 AM • 0 replies • view on HN

Speed can mean two things: rate of token generation or time to finish a task. What maters it the later and a model that takes a faster path to the result and uses fewer tokens because of that comes out ahead in practice.