There are many kinds of Real Time Audio.

If you just do "computer music", with no synced live instruments and external synths, it's a much easier problem, 40 ms of latency is perfectly fine, and on modern hardware it's not hard to hit that target.