alt Hacker NewsThanks! if you can think of any other large wins that you didn't mention, that'd be great; but those 5x numbers... that's brutal. I can understand the communications overhead of agent swarms; I'd love to know where the 5x is mostly going between human in the loop and not.
Largely bad pathways that aren't being caught in time.
Inefficient commands, for example I launched a bunch of agents for a task and for every command they'd first try it inside a sandbox, wait for the command to fail (sometimes that meant a timeout!) then retry outside the sandbox.
Now do that hundreds of times.
Or just crap like type checking the entire repo again and again.
If you have really tight rein on your agents you can prevent these sorts of issues, but you won't see these issues unless you are carefully monitoring what they are doing to the level of watching cli output scroll by.
Of course at some point the agent.md file needed to keep the stupid away gets so long that adherence drops.
You also end up with just stupid shit. I gave Sol too much free reign and it decided to update my DB schema to save stack traces to a DB.
Code which it then wrote a bunch of tests for. And then used a browser use agent to manually test.