logoalt Hacker News

herpdyderpyesterday at 8:25 PM2 repliesview on HN

The FrontierCode 1.1 Extended benchmark is the only benchmark that aligns with my actual LLM experiences and Astra isn't significantly better or cheaper. All this celebration, and yet it's only on-par with an already existing model? I don't get it.


Replies

Kiroyesterday at 9:39 PM

Impressive confidence drawing such a conclusion based on that.

holbradyesterday at 8:47 PM

If your benchmark shows Opus 5 winning, I really question the validity of it.