That's good but I would definitely appreciate one with cost to run the benchmark and cost vs accuracy breakdowns.
Artificial Analysis has an Index which also includes Cost per Task, Time per Task, accuracy, calibration etc. here: https://artificialanalysis.ai/evaluations/artificial-analysi...
(caveat, I work at AA and helped build this Index)
alt Hacker News
Artificial Analysis has an Index which also includes Cost per Task, Time per Task, accuracy, calibration etc. here: https://artificialanalysis.ai/evaluations/artificial-analysi...
(caveat, I work at AA and helped build this Index)