Hi,
I’m currently setting up a TrueNas 1000 Tb storage.
Here is my planned config
As a newbie, any advise/critical point of view welcomed from the community !
Thank you.
Supermicro SSG-540P-E1CTR60L (60 bays)
Motherboard X12SPI-TF with Xeon 4310 24 cores
non-RAID HBA controler (LSI SAS9300-8e)
40 x HDD 24 Tb
RAM 128 Gb
Extension 946SE1C-R1K66JBOD (60 bays)
40 x HDD 24 Tb
Planning ZFS with 5 vdevs RaidZ2
Stored in datacenter: 2KVA should be ok.
80 disks in 5 vdevs? So 16 disks/vdev? That’s pretty wide. 8 vdevs of 10 disks each, or 7 of 12 each (adding four more spinners to your total), would be better. As vdevs get too wide, IOPS suffer.
Otherwise, it’d probably be worth your looking into dRAID. I frankly don’t know much about it other than understanding that it’s generally well-suited to large pools, which yours certainly would be.
Hi and welcome to the forums.
Sounds like a neat build. Whats the use case as people can then perhaps give better feedback?
What protocols will you use SMB, NFS, iSCSI?
Are you looking to use SAS or SATA drives?
Personally I like to keep away from all-in-ones at that scale as if you have a hardware failure it can be a real pain. For the cost of 2 x 60 bays I’d be tempted to get a 2U Server head and connect that to a 90 bay JBOD but then I would say that wouldn’t I 
Good point about the number of vdevs, I will act accordingly.
Also dRAID is on my mind, but have to dig into documentation for
proper configuration.
This storage will be used as remote backup S3 device, no big perf needed.
HDD would be a mix of Enterprise SATA from WD and Seagate.
I will have a look at big JBOD bays from tomorrow to see what alternative
could be used.
Thank you.
Add a look at ES102 extension (102 bays), but way too expensive
rather than Supermicro main unit + extension…
Would more ram be helpful for such a humongous storage server?
1 PB is a heck of a big first step to take, and it sounds like you’ll be leveraging this for an object store for business backup.
Have you already talked to our sales team at TrueNAS directly? We’d be happy to spec something out for your needs, including warranty and optionally a comprehensive support plan if needed.
Give me a shout or a tag either way. 
