That's what RDP, VNC, etc. are for.

They are usually tied to specific user accounts, it's true. But that's something some people made up, and it doesn't have to be that way.