alt Hacker NewsSomeone built an open-source version of this, but it’s far from polished:
https://github.com/joeblau/subvox
There was this really interesting one where it reads your lips:
https://github.com/amywork777/lipflow
I’m using these to build my own so I can work in co-working spaces, planes, and libraries. Though moving my mouth with no words might draw some eyes.
Replies
willio58 • today at 5:35 PM
> There was this really interesting one where it reads your lips
This is what I thought the original post was about. The glasses you have to wear is where that lost me.
If we could get lip-reading via your computer/phone camera down perfectly, that's the real win. Making people wear your goofy frames is where you lose a massive portion of people. Nobody wants to look like Zuckerberg lol
➕ show 1 reply
Yup we worked with IMUs as well when we started this. They measure aggregated face motion, so cannot distinguish between fine phonetic classes, only broad words. The open source demo got to a 5 word classifier, I believe. We tried a lot to make IMUs work too, in various form factors, but the signal doesn't contain enough information for open ended decoding beyond classifying between a few words. We would have loved to be able to just push software!