Ibwas looking for something specific late last year, and I made three bookings (ca €500 each) for places found on the $site with the $bot.

I didn't ask the not to use this site, my query was broad and complex and would take me days to do it myself. I wouldn't

I'm quite certain they earn a hearty commission off it, and I think it was mostly possible because the site was "friendly" to bots. Otherwise I probably wouldn't choose the site because it's never any of my top choices when I look for this myself.

So, maybe you monetise it like this? You asked, I answered. Doesn't fit every site or business profile.

You take your site off the public internet and paywall it off. Websites on the open internet should be accessible and ideally the goal should be to share something cool with the world, not just to make yourself rich.

https://claw-guard.org/adnet

https://blog.cloudflare.com/introducing-pay-per-crawl/