What's your data storage and backup strategy?

I’m still figuring out my whole backup strategy, but I’m definitely getting there with my Mac Pro 3,1, I’ll post the pictures of my Time Capsule upgrade as soon as I get the office. Right now I’m eating brekkie at home, but I’m about to toss my MBP in my back and go catch my train.

Just a note that High Sierra doesn’t like software RAID setups - which has broken my RAID0 on my desktop SSDs - not a huge deal as that was more for speed and actually reduces redundancy, but just in case other people rely on other RAID setups using software and wanting to upgrade.

Time Capsule first gen upgrade. 3TB up from 1TB. I got it for $50 like three years ago, so not worried that despite my best effort, the bottom cracked.








So now I have RAID 0 SSDs in standard bays (but I hope to get a PCI card for them soon), and two 1TB drives in the Mac Pro, and the 3TB Time Capsule. In addition to the Time Capsule Time Machine backups, I also do nightly clones to a partition on one of the 1TB drives of the boot drive.

1 Like

I did the same thing and the same thing happened. Who cares, it’s hidden hey!

1 Like

Great to see my thread getting a bit of love lately :smile:

Things have changed a bit at my place. I no longer use the N40L - a couple of the drives started showing signs of impending death, so I unplugged it and put it on a shelf. One day I might put it to use ¯\(ツ)

I’m currently using a 5TB external USB drive connected to the Mac mini as my media storage. This is mirrored manually via rsync every week or so to another external drive.
I don’t use Plex anymore, I just use Infuse on an Apple TV 4 to access my media. Sometimes I use a cheapy S905X box running LibreELEC instead, but I have a love/hate relationship with it.

My photos are in iCloud Photos and my iTunes library is in Apple Music.
Additionally, I have the Mac mini backing up to Backblaze (encompassing the media drive, photos, iTunes etc) as well. On my 100/40 NBN link it took around 6 weeks of uploading, mostly between midnight and 7am (unmetered traffic during offpeak on my ISP) with a couple of days at the end of each billing cycle to smash through my quota :wink: - as a result I’ve got around 5TB of data backed up in the cloud should something bad happen.

I figured that I can pay for a couple of years of Backblaze for what it would cost to replace the dying drives in my NAS. Given that the NAS drives are relatively small by today’s standards, it was looking like a fairly expensive proposition to replace all 6 1TB drives that are fitted.

It might not be the best backup strategy, but it seems to do the job at this point. If worst comes to worst Backblaze will mail me a drive or two containing my data.

Backup Strategy in place:

MacBook backs up to TimeMachine volume on Drobo NAS
Plex server backups up to NAS and a local disk (using Crashplan)
TimeMachine backup also backs up to CrashPlan

Long term plan to to somehow afford another Drobo and drives and the locate one at work and mirror NAS at home to NAS at work.

You can never have too many backups!

I have unlimited home internet…

I have unlimited home internet…

I have unlimited home internet…

I guess I should consider online options…

Backup?

None.

Hence why I’m recovering my own data this evening.

Alright, perhaps “none” is inaccurate. I backup four machines in total to dedicated LaCie external drives, one per machine. Time Machine handles the automatic backup. No cloud backup here, because the cloud never seemed like such a brilliant solution for me, and given that the internet connection where I live is capable of around 740kB upload, not exactly a viable one either.

My MacBook Air is the odd machine out. I use it primarily, it stores a bunch of data on the SSD but nothing overly critical. Some of it is backed up across the other machines and hence across the other drives as well - Music, Movies, Photos and the like. The Desktop and Documents are exclusive to the Air, because they contain project data for whatever I’m working on at that exact moment, and those are backed up to the dedicated backup drive for this machine.

The same backup drive I was in the process of repairing when my filesystem turned to dust this afternoon.

My backup solution didn’t account for “data lost in transition”. That is the possibility that both drives could experience some form of corruption within the same window of downtime. It’s not exactly a common occurrence, but it happened, and the chances of getting the lost Desktop and Documents folders back are slim to nil.

Thankfully they contained nothing of any real importance, some files for projects I was never going to complete anyway, outdated receipts from a decade ago, some old articles for MacTalk, some TV shows and videos that are replaceable…

Doesn’t mean I’m thrilled about it. Because I spend most of my working life telling others how important backups are, it’s a bit of a slap to the ego.

The best part? The drive works, but the data was deleted because of a script intended to clear the App Store cache files to force re-download macOS installers for local use (another project) didn’t cd into the directory successfully and without checking to see if it had, performed an rm -rf ./* on the contents of the home folder.

I’m sure there has to be a relevant XKCD comic there somewhere.

Would these folders be too big to use iCloud sync with? Or to do what I do and make the desktop and documents folders symbolic links in Dropbox? You’d never have to worry about it then.

Yep, they’re constantly changing but usually 20GB+ at any given time. Thinking about some kind of network attached storage solution that backs up the volume wirelessly, not a Time Capsule but something I can assemble from the components I already have.

Thankfully I remembered I had most of the data backed up on my older backup drives, and because they still worked I hadn’t thrown them away. Turns out I hadn’t erased them either, so while the data isn’t exactly current, the drives still contained the oldest (and most important) files. Restored from backup and I’m back in business.

I did a stupid thing - I consolidated my partitioned drives when I converted them to APFS, and backed up almost 4 Tb of local data - took 4 days to do via local crashplan. Then like a stupid person, I used CCC to clone my local OS drive onto the same consolidated drive, assuming CCC would make a disk image, not completely delete everything on that drive.

Thankfully no data was lost, as I still have the original (good thing I didn’t try it on my actual live data drive). I just had to repartition the drive, and re-backup the data again - will take another 4 days.

Lesson learned.

When I picked up my 4TB WD MyCloud NAS drive, I intended to use it to remotely store all iTunes / iPhoto / Docs etc. Then I read that Apple does not recommend using non-Apple-formatted drives for storing those libraries… But after reading several blogs etc, decided to go ahead regardless, having already purchased the drive.

Whilst transferring the data from my multiple Macs, there was a glitch, however ultimately everything seemed to be safe… Spot checks all good… So I then put 2 of my original drives into a new enclosure set to Raid 1. That’s when I then learned that a random selection of music files were corrupt… unrecoverable… And, well, somewhere along the line - possibly my own fault rather than the drive/format/etc - it would appear my wedding photos may have possibly disappeared… (Should have them on a disc somewhere…!)

I then ended up with a 2nd 4TB Cloud because the first was misbehaving… So my plan was to get another Firewire enclosure to stick the 2 x 4TB drives in, and use that as my data collective, on good old safe Mac Journaled blah blah. Looks like a firewire Raid box will set me back around $250…

Then I remembered that my iMac crashes when I stress it with Final Cut Pro… probably needing a new graphics card… $200…

So… hell, may as well invest in a mid series Mac Pro (tower) instead… with 4 bays for drives… So that’s my new obsession… first am digging out all the old bits n pieces to sell off… (sans TAM, don’t even ask).

I’m only saving photos to my Seagate portable 2TB external HDD

Since this thread got bumped, an update from What's your data storage and backup strategy? - #45 by FaultyTaco

Those 4 and 5TB drives I was mirroring 4 years ago, well I kind of outgrew the 4TB of redundancy and for what was intended to be a short term started runnning them as single drives - without redundancy or backup.
Life got in the way and not that long ago I realised that my temporary situation had become somewhat more permanary - and I somehow added another couple of 4TB drives connected to various computers… Apparently when it comes to storage I like to live dangerously.

So I finally (within the last few weeks) let the moths out of my wallet and grabbed a Synology DS1520+ and a trio of 12TB drives, this gives me 24TB (21TiB) of storage, of which after migrating most of what I had on various drives (everything I value has been migrated) I have 57% free, and 2 drive bays for future expansion.

The mid 2011 Mac mini? Still going, containing the master Photos and iTunes libraries, syncing Photos to iCloud and backing up to Backblaze. It’s also a Time Machine target for my M1 13" MBP. Why am I using that as a target? Backblaze - means I get an onsite backup and offsite backup of my MBP in one step.

Probably still not a perfect setup (NAS is not a backup yada yada yada) but I’ll mirror the more important stuff from the NAS onto a couple of hard drives and keep them in various places offsite. That should do.

Oh, and I’ve still got the N40L with 6x1TB drives hanging around in storage… it’s not been plugged in since I pensioned it off 4+ years ago but I’m pondering if it has any value to sell now. Might have missed the boat on that one :laughing:

It’s a little messy. But mainly due to trying to cover several different devices.

All iDevices, phones and ipads etc, backup to iCloud. Photos are also backed up locally to a NAS. Have 2TB of storage through Apple One sub. Covers them off nicely.

All PCs and Macs backup first to one of my NAS devices. Then depending on the content of each machine, some content will be then synced to cloud storage. Planning to relocate one of my NAS devices to my folks place at some point to have offsite backup that way.

Ok, since this thread has been resurrected, I thought I would update my current backup strategy.

Local:

MacMini 1 Tb drive connected to a Pegasus R8 (8 x 3Tb = 24 Tb) - RAID 10 - so it’s 12 Tb.

That is backed up nightly using Carbon Copy Cloner to a Pegasus R4 (4 x 3Tb = 12 Tb) - RAID 5 - so it’s 9 Tb.

Cloud:

The MacMini is synced with iCloud Drive 2 Tb.

The Pegasus R4 local backedup is backed up live to Crashplan in the cloud.

Since my post above… wow… I am actually now a good backer-upper! :slight_smile:

I have a 4TB Time Machine disk which covers my boot SSD and video editing drive, and a 4TB “clone it now and then” disk to cover my “Media” drive (ie Plex and other stuff), both sitting inside my FireWire 2-bay enclosure.

I have also been sorting about 20 years of photos, many of which have up to 8 different copies (plus thumbnails) after migrations to different machines / back ups etc. That folder of sorted photos is both Time Machine’d and cloned.

By having the 2 back up drives inside the 1 external enclosure - in theory at least I can just grab it and run if needed. (Could even break a window from outside and grab it, not that it’s obvious from outside.)

Previously I have also held some data at my parents house as an external backup. I haven’t updated that for years though… Should probably update it!

Hmmm… great idea to have an actual escape plan in case of disaster. Haven’t really thought of it. Will carry off the backup drive enclosure. Although everything is already in the cloud.

The breaking a window idea wasn’t part of the plan… :slight_smile: But yes - I definitely aimed to put all of my backup data into an easy to grab box. Especially being my main machine is a Mac Pro - just grabbing that wouldn’t be so easy! :slight_smile: