alt Hacker NewsWhat are the challenges of doing that when so much of the internet has turned itself into SEO slop to fit Google's algorithms?
I imagine there is still a whole load of stuff out there on the internet that Google would never surface because it doesn't have enough adsense or whatever. Are you finding that?
That's what SlopStop is for :) developing methodologies that scale for detecting slop.
I mean it sounds like that already has a lot of overlap with our Small Web indexing efforts, so that part of our indexing efforts could be an extension of that. A lot if this is still in development though so I can't speak on specifics just yet.