Asklemmy

51781 readers

160 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 6 years ago

MODERATORS

How to archive web pages? (lemmy.ca)

submitted 1 month ago by starlight@lemmy.ca to c/asklemmy@lemmy.ml

18 comments fedilink hide all child comments

I used to use archive.today to archive news stories. However, between recently experiencing issues accessing the site and now that FBI trying to shut it down, I need to find a new way to archive.

I came across ArchiveBox, but it seems like you have to self-host and I don't have the tech skills yet to self-host an application. I also know the Internet Archive has the WayBack Machine, but never have good luck using the site.

I am hoping that I can find a site that is similar to archive.today and is not on the FBI's watchlist.

you are viewing a single comment's thread
view the rest of the comments

[–] RedStrawberry@lemmy.blahaj.zone 2 points 1 month ago* (last edited 1 month ago) (1 children)

As others have said, SingleFile extenstion works well. I've also found zotero with the web extension quite good. Its useful for added organisation/catagoriesation especially since I'm already using it for academic work.

There is also zimit for use with kiwix, both a comandline version(see github) and website if you want something simpler.

Although I've found the website has long queues quite often and it may not get a clean backup if the website uses cloudflare or the like. But its useful if I need an offline copy of a website with many pages.

I recommend having a look at the archive team wiki page on software, here, see if anything fits your needs.

[–] starlight@lemmy.ca 1 points 1 month ago

They all look like they can work. Zimit especially looks interesting. I'll take a look at all of them. Thank you!