Meta is an exception. They intentionally ignore robots.txt rules. (No second chances, I blocked th...

Symbiote • yesterday at 4:33 PM • 1 reply • view on HN

Meta is an exception. They intentionally ignore robots.txt rules.

(No second chances, I blocked their whole IP range.)

inigyou • yesterday at 8:02 PM

Everyone ignores robots.txt because every robots.txt blocks everyone.

➕ show 1 reply

alt Hacker News