I wrote streampager a few years ago to scratch a similar itch. It works well enough for my own uses (and is/was used in library form as the built-in pager for sapling and jj).

I think it still needs some work for more general use which I unfortunately don't have time for at the moment.