> Cache plugins still go through the PHP interpreter. I'm under the impression there still isn't anything faster than serving HTML files.

Several WordPress caching plugins, like W3TC (https://wordpress.org/plugins/w3-total-cache/), actually add rules to your Apache/Nginx server so that the cached HTML pages are served statically without touching PHP.