The better alternative to most of this is to use a different display protocol, one that gives you pixel-level control, if you want pixel-level control.
Can you name one which is as lightweight and simple to use as terminal escape codes and supported by almost any platform with a screen and keyboard?
This protocol would still be used for user interfaces, but it would use a completely different approach to rendering them, I guess we could call this approach "graphical"?
Now we are in GUI app territory which is why I don’t like this terminal proposal or even kitty gfx. The terminal should be about text processing and at most a 2d grid of cells. Once you start talking about pixel buffers replacing cell buffers I fear we have lost the plot.