TrueNAS Scale zpool config for media?

Greetings!

First, I originally posted this on Reddit (r/truenasscale) but it seems like it isn’t getting any traffic over there. I thought I would try here; this seems more appropriate anyway. Thanks!

So I’ve been putting off jumping on the TrueNAS/ZFS bandwagon for a while now because I never liked not being able to expand vdevs by adding drives. I didn’t like the idea of dropping a couple thousand dollars to add a whole new vdev to expand the pool. Ironically, now that vdev expansion has been added to ZFS (already? near future? …doesn’t matter anymore), I have enough drives, in the size I like, to build a zpool large enough to store all my data. So I thought I’d pop in and see what the community thinks of my plan (i.e., I’m seeking validation).

My current system is used purely as a NAS for media that I serve with Plex. Plex, and everything else (*arr apps), is on another system and runs in VMs. I currently use OMV in a VM with a 9361-8i raid controller passed through and a Raid6 6+2 with a hot spare; these are all 20TB Seagate Exos SATA drives. My server chassis is a 15-bay chassis and the filesystem is BTRFS. I hate the whole system…except the 15-bay chassis. BTRFS is not reliably available in OMV…at least for me.

My plan is to add a TrueNAS Scale VM and passthrough a 9300-16i SAS controller that I already have. I’ll build a zpool with one vdev of 7 drives in raidz2 (5+2) and I’ll migrate the data from OMV to TrueNAS Scale. Once that is done I’ll remove the drives from OMV and add them to TrueNAS Scale to make another vdev in the same zpool with 7 drives in raidz2 (5+2). I’ll have one drive left that I’ll use as a hot spare for the zpool. This TrueNAS Scale instance will serve as a NAS only and I will not be running VMs nor containers. It will serve my media library to Plex so my family in multiple locations can enjoy what I have. When I eventually need to expand I’ll go with another SAS controller, chassis and more vdevs of the same construction. I want one coherent filesystem that can grow at least twice more by adding vdevs after the migration is done. Memory for the TrueNAS VM will not be an issue as I have plenty.

Again, I won’t be moving Plex to TrueNAS no matter how many others do it that way; I like where I have it now. Also, I’m not keen on doing a bunch of 3-drive mirrors or other such expensive protection levels. Losing two drives out of seven to protection is about as costly as I’m willing to go. I would actually go wider if I had the drive bays and drives to create that first vdev so I can get everything moved from OMV to TrueNAS. In any case, keep in mind my chassis limitations. I will have seven drive bays available to get this started with the other eight becoming available after OMV is left empty.

So that’s it. Have at it! Please let me know if I’m on the right, or wrong, train of thought here. Thanks!

Nothing wrong with it that I can see

1 Like

Sounds good :slight_smile:

With raidz VDev expansion coming in the future (in beta right now), If you decide to upgrade to a 24 or 36 bay chassis you could even contemplate adding an extra drive or two to your vdevs.

1 Like

Same: 2 x 7-wide raidz2 + 1 spare is a fair use of a 15-bay chassis.
It’s ironic you won’t be using raidz expansion at all with this layout.

1 Like

etorix, Just curious, but are you suggesting that you’d consider vdev-expanding the 5+2 to fill out the the chassis, or some fraction of the chassis? I think at this point I wouldn’t want to use a beta feature with the only local copy of my data, but its an interesting idea nonetheless.

Not at all. The layout with two 7-wide vdevs a spare fills the chassis, is fairly balanced (I consider 6- to 8-wide wide to be the sweet spot for raidz2: wide enough to be space-efficient, not too wid eto become problematic in a resilver) and does not need any expansion—actually, it does not allow any expansion other than replacing drives with larger ones or adding another shelf.
You can set this up right now with CORE 13.0U6, 13.3, or SCALE 24.02 Dragonfish. As you said, you now own enough drives to set up.

2 Likes