> as the LLM part is nowadays far from being the component that delivers the highest value

Yes it is. The rest of the agent could basically be a while loop, a two sentence system prompt and a shell invocation, and it would still work reasonably well.