> I get the sense that GPS time is accurate to within 1/30th of a second, if not way way more
You are off by 6 orders of magnitude, GPS time is accurate to within 30 ns: https://www.gps.gov/gps-accuracy