Are there any LLMs being widely used for audio classification? I know VLMs are being used a lot in image stuff.

It always seems kind of silly to me to throw everything at an LLM. I know they’re huge and can automatically handle a huge number of tasks but something in me finds it wasteful when we could be creating easily trainable, cheap to run bespoke models for a lot of stuff

Note that while the underlying birdnet-go project started as BirdNET only, it can now use Google Perch v2, BattyBirdNET (for bats!) and other models in the future. It's a really cool project!

Why would anyone assume this uses an LLM? It classifies bird sounds, not human language. I don't mean this as an attack, I'm genuinely curious! This seemed obvious to me, and I want to know what line of thinking might lead one to believe that an LLM is the better (or more likely) tool for this job over a purpose-built classifier.

Curious if there is a similar project for dog barks.