FWIW, having known the people responsible at Google for dealing with SEO spam...
It was never a question of resources and it was never a conflicting goals issue. From Google's standpoint, SEO spam is an existential threat because if somebody solves filtering for it, everyone will switch to that competitor.
It is simply a hard problem to solve at scale. Successful spammers live on the razor line between the signals Google has for useful content and wasting people's time.
The element Google can't control for is human nature. SEO spam sites are built to keep organic users reading long enough to tip the quality signal in the site's favor. Savvy users like those in this conversation know what they look like, but remember that most of the internet is not composed of sanity users. So the signal Google mostly gets from those pages is that they are holding user attention, and holding user attention, and holding use your attention because the site is annoying to retrieve information from is difficult to distinguish from holding user attention because the site is good.