alt Hacker NewsCame here to write this. I am getting much better results from Firecrawl (not affiliated with them, just a happy customer).
Replies
kordlessagain • today at 6:11 PM
I'd love for you to kick the tires on https://grubcrawler.dev
RamblingCTO • today at 2:12 PM
fuck firecrawl. they copied my idea by showing interest in my product and then copied it, used their YC money to give it all out for free. fuck nick in particular. I'm still salty over this
➕ show 2 replies
As someone who helps keep a site online with a lot of content, I have mixed feelings on Firecrawl.
On one hand, their bots seem much more well behaved than others.
However, running a crawler fleet which is deceptive and evasive in its identification and don't honor REP is no way to build a business.