logoalt Hacker News

artemisartyesterday at 5:10 PM1 replyview on HN

Interested also, which text-to-speech model do you use? For diarisation Granola uses a chrome extension instead of a bot if that can give you ideas.


Replies

properbrewyesterday at 6:12 PM

I think this is just to capture the audio to ship off to their servers and do the crunching. You mentioned the word "extension" and thank you so much, I've been thinking about how to do integrations as it's something a few users have mentioned, but keep the whole "completely offline" angle. I could build standalone extensions that integrate with it if it's something a user wants. So damn obvious in hindsight!

Ahh yea as for the models:

Speech to text - Nvidia Parakeet TDT 0.6b V3

Diarisation - Nvidia Marblenet for the speech detection, TitaNet-Large for the embeddings and then using NeMo multi-scale to do clustering around them