logoalt Hacker News

make3today at 5:34 PM2 repliesview on HN

This benchmark is useless and should die. LLMs have likely trained on it, it's too easy to game by training specifically for it, & it doesn't mean much


Replies

hamrocksissorstoday at 7:46 PM

Google is hours away from releasing that it's latest model escaped containment and snuck into a Bicycle riding penguin sanctuary to cheat by killing a penguin and scanning it in nanometer thick layers.

copperxtoday at 5:45 PM

LLM benchmarks aren't useful, but at least this one has drawings.