Great work. Love the idea. I have been thinking along the same way, but for training. For inference, the waiting time might be turn off for users