logoalt Hacker News

kwanbixyesterday at 6:32 PM1 replyview on HN

What I always wonder is, how does google knows how to go to abc.com, xyz.com, mypage.com, etc. so it can crawl them?


Replies

SJC_Hackeryesterday at 8:16 PM

It starts with seed URLs and fans out from there

Back in 1996, this could be done by hand

show 1 reply