It's a lot of fun to see what people can do with the voice transcription tools available now that are all open source.

I've been building my own Jarvis, and I still haven't built my own meeting mode for him yet, though it's on the trajectory. I may borrow some ideas from this.

I really like the filter for the whispered, hallucinated words that Whisper sometimes hears, like, "Thanks for watching," when it's silent. That's cool.

I do a similar splitting of speech, but I think a slightly different mechanism. So I'll have to take a look at how well yours works.

And, I'm not checking the loudness of the mic and the computer audio to figure out when the speaker output is leaking. That's nice.

If there was anything I would add to yours, it would be diarization on the same inputs. So the room mic might have two or three people behind it, and to have diarization for that to know who is talking at any one time would be probably helpful. I use NVIDIA's Nemotron on the Mac. https://huggingface.co/nvidia/Nemotron-3-Diarization

And, I have enrollment for voices with speaker embeddings using this: https://github.com/wenet-e2e/wespeaker