logoalt Hacker News

triceratopslast Monday at 1:55 PM1 replyview on HN

Why would token speed matter for anything other than getting work done faster? It's in the name - "speed".


Replies

dminiklast Monday at 7:21 PM

This would be true if the models were capable of always completing the tasks. But, since their failure rate is fairly high, going in a wrong direction for longer could mean that you take more time than a faster model, where you can spot it going wrong earlier.