How is every company able to show itself at the top of every benchmark?
Not much moat, incremental improvements, cherry picking models to compare.
To be fair, seems more correct to compare against similar strength models if your main edge is pricing.
Anyone deep in the AI realm know which is the gold standard benchmark for coding?
They're being called "trust me bro benchmarks" for a reason ( ・ั ﹏ ・ั )
Wait to the exact moment your model is ahead on at least N benchmarks then publish.
First look what models are worse in a set of self selected benchmarks.
Second, compare to older versions of competitor s models.
Still does not look good? Compare to own previous models.