Well, yes. There is always some form of it on TCP.
But your HTTP/2 reverse proxy won't block fast responses on slow responses.
As long as your WebSocket reverse proxy does the same, you're fine.
(And same stipulation for your client.)