Well, that's just one implementation (the easiest). You may have the harness automatically inject stuff into the ongoing conversation, in which case most of the work is not done by the working agent (though you may still end up using, possibly a smaller model to help with deciding/forming the to-be-injected context).