logoalt Hacker News

mcintyre1994 • today at 5:31 PM • 1 reply • view on HN

Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started.


Replies

seizethecheese • today at 6:23 PM

> a model that's more token efficient but more expensive per token can be cheaper for a given task.

True, but I'm skeptical that this is now overly used to ignore cost per token. Your comment inspired me to do a quick investigation. Looks like in my data, 92% of cost per task can be predicted by cost per token https://micjm.com/blog/cost-per-task-vs-token/

➕ show 1 reply