I had a similar issue with an older version of Restic + Hetzner, update to latest stable, if you haven’t yet. It improved my speed literally 10x, something to do with buffering over ssh.