It is true of many models, if you ask "do you have any questions" they will ask question, even if task is obvious model will make dumb question up. But if you do not ask, they start task and never ask. Maybe it is better to not anthropomorphize the models.

Yes this would be a good benchmark. Many tasks with incomplete requirements, where trying to do the task = fail, asking right question = success.