As far as I understand it, yes, you have to be connected locally.

The question is, will it work over Tailscale/WireGuard? I'd assume so, but I've honestly never tested local pushes as I simply haven't needed them :)