I strongly agree that accessibility/programmatic UI control is the way.

But also: app builders are never going to get in line. UI will incessantly produce novel new spins. And widgets.

Yes the system should demand those have good DOM like expressions, be good components.

But I also feel like using vision processing a pretty direct way to work around making the better world, and while I wish we could make that better orderly world, I think there's something practical and real here.