I agree, we're not at that kind of long horizon capability yet. You still need a human in the loop to do manual testing. For whatever reason, we managed to automate the skill before we managed to automate the focus.

So, for now, humans need to stay in the loop and do low skilled labor to keep the skilled work the models do from going off the rails.