I work in infrastructure (backups, networking etc) and no longer in software. I just don't see llms being that useful right now. If I have a problem and ask an LLM the answer is either fabricated or useless, rarely does it know what it's talking about. And yes I know how to describe the problem so that it has a chance to give an useful answer.
Also even with agents, you can't just try and error your way out of some (most) of the problems I encounter without doing harm if the solution fails.
Might be different if used for infrastructure as code or ansible or some such. That I can see.
Well Coding agents are being tackled. Infrastructure agents that would read your host event logs, device configuration, ilo, etc, etc - that is probably the missing piece.
Having a chat with chatgpt may give you clues or ideas when you have gone throught your own checklist of what could have went wrong, but can go only as far.
Agent on the other side will decompile .dll to find out issues if needed to go deep enought.