Asklemmy
A loosely moderated place to ask open-ended questions
Search asklemmy π
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- !lemmy411@lemmy.ca: a community for finding communities
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
You can save as HTML but animation and videos wonβt work. Try singlefile extension
Archive.ph is good, especially because I've never met a paywall it couldn't bypass. π
archive.ph is just another alternate hostname for archive.today.
Oh. In which case it still works fine for me, what can I say. π
Why are specifically are you using archive.today? To post links that bypass paywalls, or for something else? Because if itβs for something else then there may be other solutions, like using archive.org or saving the page locally.
I mainly use it to read articles that have paywalls.
AFAIK, archive.today is the best around for that, outside of installing the Bypass Paywalls Clean browser extension for Firefox or Chrome.
I'll take a look at the browser extensions. Thank you!
Tbh internet archive and wayback machine is the best option I can think of. It's easy to use and I only had problems with it when I was looking for old archives from late 90s and early 2000s, it sometimes didn't load. That's the only problem I had w wayback m.
Just learned about Readeck the other day. Self-hosted for now, but it sounds like they're planning to launch a centrally-hosted instance at some point, maybe keep an eye on that.
I'll definetely keep an eye on Readeck. Thank you!
If you have a machine and/or the storage for it, you could deploy a docker container of linkwarden and do it yourself for a lot of things.
It says it's for "bookmarking" but in addition to storing the outbound link, it takes backups of pages as text, html, and PDF and can do so recursively with the pages links. Nice interface, makes stuff searchable and taggable etc.
That's really cool. I didn't know Linkwarden could do that. I'll further take a look at this, thank you!
As others have said, SingleFile extenstion works well. I've also found zotero with the web extension quite good. Its useful for added organisation/catagoriesation especially since I'm already using it for academic work.
There is also zimit for use with kiwix, both a comandline version(see github) and website if you want something simpler.
Although I've found the website has long queues quite often and it may not get a clean backup if the website uses cloudflare or the like. But its useful if I need an offline copy of a website with many pages.
I recommend having a look at the archive team wiki page on software, here, see if anything fits your needs.
They all look like they can work. Zimit especially looks interesting. I'll take a look at all of them. Thank you!
What's your use case?
Mainly to bypass paywalls.
singlefile or webrecorder in chromium based browsers maybe?
self hosting is actually pretty easy actually :) we're here to help too.
for large scale crawling i usually use archiveteam's grab-site.