> Google's limitation is that they still don't offer TPUs in a PCI-E card/dev board that people can plug in to their PC for local development

I’m not familiar with this field, but to my brain, https://www.amazon.com/s?k=Google+Coral seem to show me several such options.