logoalt Hacker News

deepwoodsyesterday at 10:23 PM0 repliesview on HN

In theory, as long as all the models are doing the same thing with the same tools, it's at least useful to see how they stack up against each other right now. It might not be great to track progress over time, as it can get benchmaxxed or the underlying resources may become obsolete.