logoalt Hacker News

woadwarrior01 • yesterday at 10:59 PM • 1 reply • view on HN

The way that site charges a fee[1] for benchmarking models, makes any benchmarks on it very sus, IMO. TBF, the benchmarking site is probably more profitable than TypeSafe, just like the joke about how WinRAR is more profitable than OpenAI[2]. :)

[1]: https://benchmarkheaven.com/submit

[2]: https://news.ycombinator.com/item?id=49797811


Replies

Maxious • today at 2:27 AM

https://huggingface.co/spaces/multimodalart/jev-decision-ind... is also ranking just for the love of the game.

Given that benchmarks are useful, why not give them economic value?

➕ show 1 reply