Kokoro can be hacked a bit (see script https://github.com/DavidVentura/translator-rs/blob/master/sc... ) which makes it about 3x faster.
My phone went from slightly slower than realtime to very comfortable (also lower latency on first utterance!)