logoalt Hacker News

smokeeaasdtoday at 2:55 PM0 repliesview on HN

The internally-reported benchmarks (Frontier-Bench, AutomationBench) and the customer quotes (Cursor, Devin, Lovable) all have a commercial stake in the outcome

worth waiting for independent evals before drawing conclusions.