logoalt Hacker News

iamdelirium • today at 7:09 PM • 1 reply • view on HN

FrontierCode 2.0 is such a poor benchmark for Gemini since it's the only model forced to use Devin CLI while other models get to use their preferred harness.

I wonder why that team singles Gemini out like that.


Replies

mattlondon • today at 7:38 PM

Probably can't work out how to sign up for the API!