They (OpenAI models) are very tuned to be depth first and you can coach them all you want to try to be breadth first but as that context window fills up on those long running tasks they drift back to their first principles, which means obsessively testing and verifying a singular task rather than proceeding to the next task on the list
If you're using a sufficiently flexible harness (perhaps your own) you can make conversations as branchy as you want.
This explains why I like GPT: I LIKE for them to excessively test each step, kthx!
I wonder if that depth-first/rabbit-holing tendency is why GPT models tend to be better at mathematics (my own experience) than code.