Actually they are asking programmers to become managers in addition to programmers. Because when the LLMs stops working, they are expected to take over.
So I think programmers who are asked to use LLMs should demand their job descriptions to be changed to that of managers, and should ever deny responsibility if the LLM stops to make progress. Thus let the organization be responsible to actually find a version of AI that works, just like how it was responsible to find competent programmers to work under the managers before.