I know that making networks out of duct tape and bubblegum is a point of pride in the Linux community, but if you have to store vital data, wouldn't a nice hardware NAS and a RAID array be a better solution?
this post was submitted on 07 Aug 2023
221 points (99.1% liked)
linuxmemes
23488 readers
921 users here now
Hint: :q!
Sister communities:
Community rules (click to expand)
1. Follow the site-wide rules
- Instance-wide TOS: https://legal.lemmy.world/tos/
- Lemmy code of conduct: https://join-lemmy.org/docs/code_of_conduct.html
2. Be civil
- Understand the difference between a joke and an insult.
- Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
- Don't get baited into back-and-forth insults. We are not animals.
- Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
- Bigotry will not be tolerated.
3. Post Linux-related content
- Including Unix and BSD.
- Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of
sudoin Windows. - No porn. Even if you watch it on a Linux machine.
4. No recent reposts
- Everybody uses Arch btw, can't quit Vim, <loves/tolerates/hates> systemd, and wants to interject for a moment. You can stop now.
5. π¬π§ Language/ΡΠ·ΡΠΊ/Sprache
- This is primarily an English-speaking community. π¬π§π¦πΊπΊπΈ
- Comments written in other languages are allowed.
- The substance of a post should be comprehensible for people who only speak English.
- Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
6. (NEW!) Regarding public figures
We all have our opinions, and certain public figures can be divisive. Keep in mind that this is a community for memes and light-hearted fun, not for airing grievances or leveling accusations. - Keep discussions polite and free of disparagement.
- We are never in possession of all of the facts. Defamatory comments will not be tolerated.
- Discussions that get too heated will be locked and offending comments removed. Β
Please report posts and comments that break these rules!
Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.
founded 2 years ago
MODERATORS
How about an external HDD plugged into the Pi? Even a usb stick is better than writing it to the microsd card.
My brain didn't even register that the meme was about NAS data residing on the SD card. I automatically assumed it's on attached disks and was about to snark-reply about keeping a cloned SD card taped to the Pi case for such occasions.
Jup same
Either go big or go home. RAID or bust.
Remote mount datacenter storage pools or go home. If you have physical room for your disks in your house, you need to go bigger.
Going from NAS to SAN - nice, but playing Amazon/MS for keeping my data is a bit much, unless i have literal pentabytes that have to be high accsses.
I've grandfathered an unlimited account at an independent company with no storage or speed cap with physical storage in a country highly rated for privacy. Even considering Amazon/MS as a potential hosting provider is... Something I wouldn't do.
Funny. My WD nas runs linux and the support ended so i've had to upgrade myself with entware... and it's old, so the fan was sized for cooler hard drives, so I cut a hole in the top and screwed on another fan... and WD removed NFS support years ago, so I just mount my shares oversshfs... and i'm currently upping my local security so it's only accessible over wireguard... honestly, I have no idea what it's doing with the hardware raid and the way it mounts drives so i'm tempted to switch over to mergerfs and snapraid...
Basically my legit consumer hardware raid nas is more duct tape and bubblegum than my home built linux nas. Then again, it's easily a decade past its anticipated useful life too.
I guess it is a point of pride.
Backups people backups. You don't realize how much you want them until it's too late to make them.
don't worry I have raid, that's a backup right?
Raid 0 right? I heard the number stands for how much risk there is of losing data.
Add more disks for more reliability
Due to the green economy I only buy second or third hand disks for my RAID0 setup
No, the backup goes after the raid when something goes wrong.
Wait, I thought you're talking about that SWAT team outside your house.
If 3-2-1 is a good backup strategy, RAID (non-zero) is like 0.5 at best. Maybe 0.6 if your config can handle 2 simultaneous drive failures
Also remember to backup before things break. I once diligently backed up a system image before an upgrade. But I backed up a already failed SD card.
Also remember to test your backup system.
Setting up an intricate backup process is great, until an actual emergency happens and it turns out you can't put Humpty-Dumpty back together
and if possible, keep some backups in a separate physical location. House fires or break-ins aren't all that uncommon.
A good advice, but most regular people don't seem to bother with rotating physical off-site storage mediums so I advocate automated (and encrypted) backups to a cloud or something as well.
If you must use an SD card: use log2ram. Greatly reduces the number of IO operations to the card and prolongs its life.
LPT: pies since at least the 3b can boot from USB.
Not quite the same, but I made the mistake of using my RPi to run my home server and NAS off of an external USB non-NAS (i.e., not intended to be running 24/7) drive...with no backup or redundancy. The drive actually lasted a good long while, but it did die, and very suddenly, a couple of months ago. And now I've lost all my stuff that was on it. Still holding out hope I can figure out a way to recover the drive, but yeah.
Back up your shit, yo.
Is it an HDD? Those are quite easy to recover, just put the disk into a working HDD
Sorry I'm not sure what you mean. Yes it's an HDD. A USB plug-in one in a non-user-serviceable enclosure. I can't (without completely destroying it) get the HDD itself out. And I'm not sure what it would even mean to put it into a working HDD. The broken HDD itself is the problem, I think.
this is what I mean by putting it into a working hdd
what model is the usb dongle?
I can't recall the exact model, but it's some form of Seagate Expansion Desktop, sort of like the ones shown here. Mine was 1.5 TB, IIRC.
Thanks for that link. Wish there was a bot to translate links back into normal YouTube videos like there's one to send you off to that other site, but it's easy enough to manually change the URL I suppose. Anyway, doing that is way beyond my skills, and I'm not sure the data would be worth paying a professional to do that either. I can't imagine that comes cheap.
Opening a HDD on your own is usually a terrible idea.
HDDs need a completely dust free environment so that no dust enter the harddrive.
load more comments
(1 replies)
This has happened several times to my Pi-Hole. Even with backups, trying to get my network back online still takes too long. I haven't found a good solution for resilience yet.
Try to use overlayfs under raspi-config, I've been running some raspberry pis for years with that (mostly on offsite locations where fixing dead sd cards is not possible)
Updating the pis is a little more work but in some use cases it's worth it
I think something like BTRFS might be a better solution as overlayfs seems to freeze the system image state. Something which is copy on write (COW) seems like it would be more resilient and still provide an RW file system. To do it right would probably be a combination of the two with the data partition BTRFS and the system image partition overlayfs.
Yeah that sounds like a good solution. I think arch based pikvm does something similar. (no reboot necessary to enable rw)
For those pis that need to write stuff, I usually mount a network drive and use that while having the overlayfs enabled. So far haven't had any issues, only one pi died after 3 years due to faulty power supply.
I use an old netbook as Pi-hole. It has a battery so powerouts are not a problem.
Honestly something that critical probably shouldn't run on a rpi. There are plenty of cheap used thin clients you can buy on eBay that have better performance and reliability. I probably like the thinkcentre micros, but feel and hp have good options too
Pis can be supremely reliable when used correctly for the purpose. E.g. use high quality SD cards and don't write to them much, or a good quality SSD if you have to do significant writes, use an official or better PSU, etc. My oldest 4 is from 2019 and it's been in continuous use since then. It used to be a NAS running a 2-disk mirror exported over NFS. These days it's a gigabit OpenWrt router with SQM. It's still in the original SD card.
Full redundant JBOD backup. It's unfancy and safe.
Pfft, mine boots from a USB SSD, and since my services are all containerized I just gzip the directory with all my docker-compose files and volumes and chuck it into B2 every 6 hours
https://raspibackup.linux-tips-and-tricks.de/en/home/
Regular unattended backups in seconds using hardlinks. Honestly, it doesnβt get any better.
view more: next βΊ