I forget the name but there once was a short lived search engine that heavily leaned on crawling new domains.
I only ran a dozen queries but it was memorable. I didn't see a website with "under construction" in it in the decade before nor the decade after.
It seems like an unfinished approach. (Perhaps add dns data?)
Someone should do a p2p search engine and crawl those 100 to 800 thousand new domains per day. Leave them in the index for a week or a month. Make the removed ones into a download, perhaps with some [traffic] data.
Then have the user set up some queries and give them a notification if a new result happens. With suggestions like `$city $restaurant`
Problem is, nobody cares enough to do that. To use that, I mean. These things were neat in the earlier Internet when it was a toy and we were seeking information. Now we have too much information.
The whole StumbleUpon idea was huge for a while too. Didn’t age well though, it was a novelty. I think this was around the time most people switched to a Feed style of information and that sucks your available attention