alt Hacker NewsYou can't just look at the per token cost, but how many tokens it takes on average to do a task. The difference can be massive.
Replies
vntok • today at 9:15 AM
True, but it would have to be more than massive (order(s) of magnitude) to offset that gap.
➕ show 1 reply
Also cache write/read cost + cache efficiency.