Agreed. This is exactly what I want, ideally with components and libraries and panels and data shareable and extendable between applications.

The closest in spirit is Probably something like Dear ImGui[0] and the ecosystem of components and apps built with it, but it's not quite there for me. Something is missing.

[0] https://github.com/ocornut/imgui