I built a very similar system into my own assistant type project. In all honesty though I've not used it enough to know how well it works out in practice.