I tried EGM on a few things over the last couple of weeks.
The biggest pitall, which is called out in the docs, is that the goldfish reviewers are never fully satisfied.
The reviewers will always find something, so you need to be able to recognize when the agent is bikeshedding and that it's time to move on.
Otherwise it's a pretty decent approach, and while I don't think it's anywhere near hands-off, it produced decent specs in both cases that didn't require too much additional hand-tuning before I started implementation.