logoalt Hacker News

thephyber • today at 1:00 AM • 1 reply • view on HN

Is there a way to use Internet Archive to download an entire site snapshot?

I tried to do this for a non-tech person whose blog articles were removed without their permission and without any notice when the blog host was M&Aed. It was a giant PitA for just about 40 article pages and I'm pretty sure I was temp IPbanned for a few hours/days.

Also, there is a lot of bitrot from people who have been working on Kryptos K4 across 30 years.


Replies

simonw • today at 1:20 AM

I used a Ruby script for that a while back, wrote that up here: https://simonwillison.net/2017/Oct/8/missing-content/

That was in 2017 though so maybe they block that kind of traffic today.