> Strategic thought is the other thing
I feel like LLMs can be very helpful to double-check a bunch of stuff here, and evaluate alternative-paths and so on, but the "direction" really has to come from you, then you can use the LLM to double-check and what not.
But if you let the LLM set the "direction", then all bets are off, as they don't have a single care about anything in the world, so they'll just do whatever essentially.
"Direction" is what I mean by strategic thought - but even if the high level direction came from you - the tactical approach might fall prey to the same over confidence which destroys direction setting in the first place.
I use it very sparingly for stuff like this - and even when I do - I discount its outputs heavily and maybe just use it let me see some blind spots and sanity testing.