I won't weigh in on whether it's "cheating" but it is definitely benchmaxxing
Yeah, unless the model is evaluated with blind hold outs, the benchmarks are misleading.
alt Hacker News
Yeah, unless the model is evaluated with blind hold outs, the benchmarks are misleading.