> same PyTorch/CUDA calls, just intercepted by a stub library that forwards them over the local network.

At that point you're making more work for yourself than debugging over SSH.