Hi yes, I should have said 2 different pools not vdev.
But in end I think I will stay with a single raidz2 8x6TB. Not needed to complicated it to much.
Once its full I would “borrow” a LSI HBA controller to start over with 4 new bigger drives.
This weekend I had time for some testing.
I am sharing this in case anyone else is building this in the future.
I am now using the Asrock x570M pro4 as the Taichi run in a technical issue.
This board has better pcle bifurcation support anyway.
The ecc memory is working and I am considering to return it as I don’t need it yet. I just wanted to have the option to upgrade later.
truenas_admin@truenas[~]$ sudo dmesg | grep EDAC
[ 0.340178] EDAC MC: Ver: 3.0.0
[ 24.486474] EDAC MC0: Giving out device to module amd64_edac controller F17h_M60h: DEV 0000:00:18.3 (INTERRUPT)
[ 24.486481] EDAC amd64: F17h_M60h detected (node 0).
[ 24.486483] EDAC MC: UMC0 chip selects:
[ 24.486485] EDAC amd64: MC: 0: 0MB 1: 0MB
[ 24.486488] EDAC amd64: MC: 2: 8192MB 3: 8192MB
[ 24.486490] EDAC MC: UMC1 chip selects:
[ 24.486492] EDAC amd64: MC: 0: 0MB 1: 0MB
[ 24.486494] EDAC amd64: MC: 2: 0MB 3: 0MB
truenas_admin@truenas[~]$
I did also measure the power usage; with 5 HDD its just 25 watt in idle.
This is with all 4 NVME and adaptor cards.
Without the HDD its 20 watt in idle C6 (mislabeled as C3).
I was worried about the chipset idle power but I am happy with the results.
I also bought 2 Patriot P300 M.2 PCIe Gen 3x4 128 GB SSD with GLOTRENDS PA09-X1 M.2 NVMe to PCIe X1 Adapter for the dual boot.
The Kingston NV3 NVMe PCIe 4.0 500gb is now in mirror pool for Apps/vm instead.