logoalt Hacker News

nsingh2today at 2:39 AM0 repliesview on HN

What's going on with sol here? The note says it spends a lot of time waiting, did it just not effectively use time (i.e. something like parallel runs) so it's graph ends up being stretched in the time axis?

I'm also seeing notes like on Opus 5 saying it was a run with a older serial version of program.md, so the graphs aren't complete apples-to-apples comparisons?

Edit: the blog seems to address these https://www.primeintellect.ai/blog/measuring-autonomous-rese...