Expose Overseerr over HTTPS either from your home network or on a free VPS which has the tunnel into the home network where Radarr and Sonarr live. This is simpler for users to go to a website instead of having to also use a VPN.
This of course assumes you already have Plex or Jellyfin exposed to the public internet without a VPN.
If you're already forcing users to use a VPN for Plex/Jellyfin then hosting Overseerr locally and making it accessible over the VPN should be trivial.
Overseer runs on plex's media port? Plex has the media port 32400 NAT hole-punched, but none of my other webservices are exposed outside my VPN.