> but LLMs have a place in vast number of places where we'd previously never use a classifier because it was too much effort.

Absolutely! But that doesn't rule out that there are AIbros that will tell you to use an LLM, even if the task could be done with a static analyzer with a few rules. Use an LLM because it's AI!