> it actually exploits the spatial/temporal redundancy of the image stream to save render compute
This is great until the redundancy no longer exists and you have to rebuild the entire state machine from zero (a humble scene transition or rapidly turning a corner).
That's true for just about any heuristic-based optimization - your assumption breaks, and the optimization with it.
That doesn't make it useless, not at all. It's still useful in its regime, and you can work around to cover the gaps where it breaks down.