logoalt Hacker News

a3nz3g • today at 2:12 AM • 1 reply • view on HN

I feel like many models are overfitting. When it comes to software development, only Opus actually saves me time.

Sol requires some back-and-forth. Other models, like Muse Wonder and Argon, are a total waste of time. They require way too much effort to get things working.

Given the same prompt, Opus can work for hours to deliver a solid result, though it sometimes overengineers things. Sol takes about 80% as much time and delivers a slightly worse version.

Other models just tell me they're done after 20 minutes.

WTH? Am I using the model, or is the model using me?


Replies

bel8 • today at 7:03 AM

Are you using same harness/agent on all of them? It makes a huge difference for long running tasks.