'roll down hill' is a good way of putting it. They don't have 'will', but that's as we want it I think. I think alignment is harder if they develop will. Without will they are still tools that feel like an exoskeleton rather than something that will control us.
Agents have a state which will unfold as a plan, especially in planning mode. Why not call this 'will'?