logoalt Hacker News

andrew_zhongtoday at 6:02 AM4 repliesview on HN

Good point. The anti-bot patches here (via Patchright) are about preventing the browser from being detected as automated — things like CDP leak fixes so Cloudflare doesn't block you mid-session. It's not about bypassing access restrictions.

Our main use case is retail price monitoring — comparing publicly listed product prices across e-commerce sites, which is pretty standard in the industry. But fair point, we should make that clearer in the README.


Replies

andrew_zhongtoday at 6:55 PM

[Update]] I will replace the stealth browser with plain playwright and remove anti-bot as a feature.

zendisttoday at 7:14 AM

Regardless. You should still respect robots.txt..

bilekastoday at 9:18 AM

> comparing publicly listed product prices across e-commerce sites

Those prices and information is for the public viewers, the reason why some people have ROBOTS.txt for example is to reduce the traffic load that slop crawlers generate. The bandwidth is not free so why would you assume to ignore their ROBOTS.txt when you're not footing the bill ?

show 1 reply