logoalt Hacker News

aussieguy1234today at 12:02 AM0 repliesview on HN

As a senior developer, I achieved last night what I thought was impossible with all the anti-bot (including bot detection) tech that gatekeeps much of the internet.

An AI agent using a web browser like a human. I used various stealth technologies to achieve this. I set it off on a research task for me and it saved me $30 of a purchase by finding the best price. Its Jeff Bezos worst nightmare, visting amazon.com and ignoring all the product placement ads.

It had multiple tabs open, did searches in multiple places, opening products and checking sites....it looked just like a human would do doing the same task.

This I can assure you would not have been possible without my expertise. I had to be very careful to remove all bot signals from the browser, including going to browserscan.net to check. Once done, most captchas were never shown to the agent. There is a NodeJS codebase involved that I wrote by hand.

I searched through the code of the browser automation framework I was using, looking for ways to make it look more human. I had AI help with this part, but had to confirm everything and pull the agent up when it suggested bad ideas.

Most of the work was architectural, including making sure my browser was easy for the agent to use.

I'm going to add 2captcha as a next step, to solve the few captchas that it still encounters (as I still do sometimes as a human).

I'm thinking of open sourcing it, but i'm not sure if its a good idea as if it became widespread, it might encourage the adoption of even more invasive anti-bot measures.