There’s a proposal to bring back cross-site file caching with a fix for the privacy issue:

https://github.com/WICG/cross-origin-storage