1413
this post was submitted on 13 Jan 2026
1413 points (99.5% liked)
News
35704 readers
3045 users here now
Welcome to the News community!
Rules:
1. Be civil
Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.
2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.
Obvious biased sources will be removed at the mods’ discretion. Supporting links can be added in comments or posted separately but not to the post body. Sources may be checked for reliability using Wikipedia, MBFC, AdFontes, GroundNews, etc.
3. No bots, spam or self-promotion.
Only approved bots, which follow the guidelines for bots set by the instance, are allowed.
4. Post titles should be the same as the article used as source. Clickbait titles may be removed.
Posts which titles don’t match the source may be removed. If the site changed their headline, we may ask you to update the post title. Clickbait titles use hyperbolic language and do not accurately describe the article content. When necessary, post titles may be edited, clearly marked with [brackets], but may never be used to editorialize or comment on the content.
5. Only recent news is allowed.
Posts must be news from the most recent 30 days.
6. All posts must be news articles.
No opinion pieces, Listicles, editorials, videos, blogs, press releases, or celebrity gossip will be allowed. All posts will be judged on a case-by-case basis. Mods may use discretion to pre-approve videos or press releases from highly credible sources that provide unique, newsworthy content not available or possible in another format.
7. No duplicate posts.
If an article has already been posted, it will be removed. Different articles reporting on the same subject are permitted. If the post that matches your post is very old, we refer you to rule 5.
8. Misinformation is prohibited.
Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.
9. No link shorteners or news aggregators.
All posts must link to original article sources. You may include archival links in the post description. News aggregators such as Yahoo, Google, Hacker News, etc. should be avoided in favor of the original source link. Newswire services such as AP, Reuters, or AFP, are frequently republished and may be shared from other credible sources.
10. Don't copy entire article in your post body
For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Worked on my VPN to Mexico City. Slow but loading. Trying to export all the data.
If you get any of it, would you mind sharing what you can?
We might be able to patch something together given multiple efforts. No telling how long the attack will last, but we can hold steady with slow progress.
it's like half up. here is some. the special:export is kinda working, but i'm very new at ripping wiki sites
https://archive.is/ipv5h
this is working without VPN - https://wiki.icelist.is/index.php/Main_Page
Any chance you know Python, or maybe you can have ChatGPT write a script that uses bs4 to parse through each of the name hyperlinks in the html? A simple loop should be able to visit each page, cache the results on disk, and finish up eventually.
The link doesn’t work where I am, still.
it's very slow for me. i'm looking into python and all the other stuff. if you one specifically that will scrap the whole site, i'm down to run it. any OS except mac i can use. i can't copy/paste each agent page, looking to scrap the whole site at once
edit!
i think i have it scraping it all to html files. it's taking time, just trying to make sure it gets the agents and incidents at least.
I see the edit, sweet!
I wouldn’t be able to write the script myself because I can’t load the site at all. So I can’t analyze the html and determine how to loop through it an extract all the additional links for scraping. Unless you want to send me the html. Then I can work with that, but without testing on the live site.
If you have something working though, great! Let’s just start there.
Check by opening one of the html files with your browser, or VSCode or something, and see if it has the data you were expecting.
the files look correct, just html version of the pages, just not sure if it's going to crawl and get every page. i don't even are if it's just a folder of html file sat this time, as long as all the agents are retrived. will keep testing.
I just set up a little bot in Jupyter Notebook to get them as well, and it’s working! Very slow, but working. I just fetched all the links to the agent detail pages. There are 1532 total. Once I fetch all the detail pages, I’ll move on to the incidents too.
Definitely keep pulling yourself, though. Who knows if I will be able to get them all?
Anything else worth grabbing while I can?
not sure, i'm looking through agents now. it's HTML, and loads with broken CSS/styles, but the text is there
we'll have more once the site is fully working. maybe the admin will allow ZIN backup downloads, make it easier to mirror. i don't htink he expected to get this much traction.
these people just straight up advertise they're pieces of shit. wow. no shame.