How many pools can i have on TrueNAS Core

I have recently built my first TrueNAS server.

I have an ASrock z87 Extreme 11 AC with 22 sata ports, an i7 4790k and 32gig ram.

My first pool consist of 10x 18tb seagate exos drives in raidz2 8+2.

My plan going forward is to add a second 10 disk 8+2 pool inside this case, and then expand further with JBOD boxes and HBA+SAS to Sata.

The motherboard has 4 expansion slots, so my plan for the forseeable future is 3 JBODs of 20 disks each on 4x 16 port HBA cards.

Can my setup/TrueNAS Core handle up to 8x 10 disk pools of 180tb++ each ?

Why not? It’s designed for enterprise use.

I use six pools on one system, one of them with 49 disks. Your wallet will tap out long before ZFS will.

Go ahead! ZFS is designed to handle entities (volume size, file size, number of files, drives,…) that are far beyond today’s practical limits. As long as you have enough room for hard drives, you don’t have to worry about any limit.

Good luck!

Two things and they are just comments:

  1. I didn’t think this motherboard supported ECC RAM and with that much storage, it might be prudent to use ECC RAM.
  2. 32GB of RAM might end up being a bit small with all the storage you are planning for. It really depends on what you plan to use this system for.
2 Likes

Movie and TV show storage and server with PLEX. one time write, one or 2 user reads

Thanks for all the replies.

Up until covid i had a $10-$15k a year physical media budget to reallocate :slight_smile:

1 Like

Just some advice from experience… Having a home media library is nice however the amount of money for the hardware, energy, cooling, and maintenance (there is maintenance, it is not build and forget), it may be better to consider streaming services.

My server started out as a media server and backup server. I have reduced my storage significantly and now it is just a backup server.

Of course if I had a budget like you to spend on this kind of thing, I may do that too. But I’d rather have a new truck, mine is old as dirt. :smile:

Good luck on your adventure.

2 Likes

LSI 3008 and expander on-board, exposed as… a long wall of SATA plugs!
I’m flabbergasted that someone had the idea to design that, that someone else approved it being manufactured, and that the contraption found at least one client.

Back to the question, you can have as many pools as you want, with as many vdevs in each pool as you want (because you may want to add vdevs to th existing pool rather than multiply pools). And when using proper SAS backplanes and SAS expanders you can have these multiple JBODs hanging on just one HBA. You do NOT need one SAS port per drive!
However if you’re ready to invest in tens of 18+ TB drives, you may want to upgrade to a motherboard which supports more RAM (preferably ECC).

4 Likes

What about the system/setup will cause TrueNAS to require more and different memory?

I am not doing any transcoding, and currently im testing out running Plex on a separate computer targeting the server for files only.

Writing to nas will not take place during movie watching.

Also on cost, i am aware that this is not a one time invest but has running cost, but compared to buying everything which i used to do it is alot cheaper.

Streaming services is a big h3ll n0. The way they keep changing their plans, removing access to 4k hdr armos etc at will, only option is to store locally for me :slight_smile:

I will still buy 4k discs on sale to own, there are bad rips from time to time, hdr artifacts etc.

I had 700+ TB with only 64gb RAM. If you’re using it primarily for media, additional RAM isn’t absolutely necessary. 32GB is a bit tight, but the system will run just fine…

If you’re not doing any transcoding, I really don’t understand why you’d run Plex from a separate computer and pull the media over the network: server → Plex → client. Just put Plex on the server. If you DO need video transcoding, you’ll probably want a cheap GPU (Intel Arc) that supports HEVC since I don’t believe the 4790K iGPU has accelerated decode.

With one 9300-16e you can connect an additional 64 drives (in JBODs) at 3gbps, sufficient for spinning hard drives. You don’t need SAS drives; SATA drives are fine.

Writing to NAS is fine while watching movies. Even the highest bitrate remuxes averages ~100mbps (12.5MB/s).

Should probably refrain from ‘rip’ discussion.

2 Likes

Watched one video on SAS extenders, but wouldnt that require a motherboard in each jbod cabinet ?

With the reasonable price of lsi 16e cards on ebay, i was thinking of having a psu + 20 drives in a case, then run the 20 cables from back of current unit, into each jbod enclosure. having a 24pin psu trigger card to power up drives with main.

As long as the motherboard and TrueNAS can handle the 60 (64) extra sata channels in addition to the 21 (20+boot drive) currently in use…

And again, as long as memory isnt an issue. If it is, i can always get another cheap older board with a decent cpu and memory and run 2 truenas servers with 40 drives each instead of upgrading current to support 80 drives.

But 80 drives is still years in the future, just trying to futureproof… if there even is such a thing with computers :smiley: :smiley:

Also thanks for the heads-up on ‘topic’ discussion.

Unsure what goes here, but on the other hand, why would ppl need NAS servers if not to store ‘content’ :wink:

Run 20 cables to a JBOD? I’m not sure how you would do that with a 4-port 16e card or how you’re planning to connect the JBODs.

My old system was the motherboard/system in a case with a single 16e card. From each port was a SAS fanout that split into two SAS connections. Each SAS connection went to an expander in a JBOD. Each expander had 2 x SAS-to-SATA fanout cables to connect 8 drives. Each JBOD needed a PSU, expander, and fan controller. Power consumption was around 800W.

My current system has a motherboard with 2 x 16e cards. A SAS connects from each port to a 12-disk JBOD. The JBOD has an external-to-internal SAS adapter. An internal SAS cable runs from the adapter to the backplane. Each JBOD has a Supermicro power board, fan controller, PSU, SAS internal/external adapter. Power consumption is around 1300W.

Sorry, i meant the 20x sata cables coming from 5x sas ports for each jbod.

Hell no! Each SAS cable (SFF-8088 or 8644) is worth 4 SAS lanes, and you can have more than one drive on each lane.
The JBOD enclosure only need a backplane with a SAS expander, and you’re all set with one cable to the HBA: No extra motherboard.

Just watched a few more videos, but im still not understanding 100%.

so this guy explained a 2 port card connecting to a 6 port card to expand sas connectivity, but is the card passive ? does it not need power to do the sas expansion ? is it powered through the sas port feeding it ?

Expanders are active. In a JBOD chassis the would be powered by the chassis PSU, just like the drives. Expanders on add-on cards are powered by the PCIe bus or by a power connector (and no PCIe!).
There’s no power in a SAS cable.

Still, with my idea

3x JBOD 20 drives each

4x 16 lane HBAs
15x sas to 4xsata cables

Or

1x HBA
3x SAS expanders
3x pci power adapters
3x sas to sas cable
3x sas backplate
15x sas to sata cable

Cleaner between boxes maybe, but how is this simpler ?

You clearly have never seen a SAS backplane…
Please do a bit of reading on SAS and try to understand how you would setup, say three of these:

It takes one cable per JBOD, at most two, and one HBA in the host. Done. You can daisy-chain.

FTFY. Oh, are you aware that SATA has a limit of 1 m from controller to drive for cable and PCB traces?

We are clearly not talking about the same thing here.

What you link to are $3-$4000 systems (pr. 20 HDs.)

I am not purchasing prebuilt rack mounting disk chassis with built in psu and backplanes.

I am putting 20 drives inside a cheap off the shelf midi tower and using a generic pc psu, and connecting them the simplest way possible.

4x HBA in main cabinet $60 each = $240

15x SAS to sata 1.0m cables $10 = $150

6x 10 disk hdd cages off aliexpress/ebay, $56 ea = $336

3 ex dutzo c731 cabinets at $70 each = $210

3x used or sale 500-750w psus, 100-150 ea, $450

+trigger cables to sync psu to start on main system power on.

Thats $1400 for everything i need for 3x20 disk JBOD’s