alt Hacker NewsAnd after i do that, how do i combine the output of 1000 subagents into one output? (Im not being snarky here, i think it's a nontrivial problem)
Replies
mattlondon • yesterday at 7:06 PM
You just pipe it to another agent to do the reduce step (i.e. fan-in) of the mapreduce (fan-out)
It's agents all the way down.
jonathanstrange • yesterday at 7:11 PM
Start with 1024 and use half the number of agents each turn to distill the final result.
The idea is that each subagent is focused on a specific part of the problem and can use its entire context window for a more focused subtask than the overall one. So ideally the results arent conflicting, they are complimentary. And you just have a system that merges them.. likely another agent.