This is actually the thing that drove me to the GUI. You can just setup connection via ssh without thinking about it. A lot of my projects either live in a VM or VPS and so using herdr was okay, but the latency was getting to me and swapped to Codex and Claude Code desktop which make it super easy to just add remote machines over ssh and then there is no latency etc.
But you can't add a VPS to codex remote, can you?