logoalt Hacker News

raw_anon_1111today at 3:56 AM1 replyview on HN

Serious question, in 2026 you can actually have a successful crawler with just curl? I just had to create one for a customer - for their own site - and nothing would have worked without using Chromium.


Replies

kstrausertoday at 4:23 AM

Probably not for most sites. Example of a site where it'd likely work: a blog made with a static site generator. Example of one where it wouldn't: darn near anything made with React.