There’s still plenty of commercial work on specialized models, for the simple reason that they’re typically much cheaper to train and run.

Many systems now use LLMs in conjunction with specialized models.