logoalt Hacker News

huertouisjlast Sunday at 10:20 PM2 repliesview on HN

there are scraping subreddits.

if you browse them you will see that bot writers are very annoyed if they can't scrape a site with a headless browser.

you can do what you suggested, but with Linux VMs/containers. windows is too heavy, each VM will cost you 4 GB of RAM


Replies

londons_exploreyesterday at 6:48 AM

The reason to use windows is that anti bot tech is going to be a lot stricter if Linux is detected...

xmcp123yesterday at 12:36 AM

I’m in those. xvfb and headless=false still works great