Well that explains why I was able to coax it to partially execute on some things without actually exiting plan mode.