Storage Dashboard shows disk already used in pool as unused disk

markperron · November 9, 2024, 1:47pm

Build: TrueNAS Scale 24.10.0.2 - MB Supermicro A2SDi-16C-HLN4F - LSI SAS 9300-16i RAID Controller Card - ECC RAM - 25 hard drives various sizes - Raid Z3 - 4 pools.

My system shows under Storage Dashboard 25 unused disks. These same disk are used in my 4 pools and all show Good Health.

If I choose Unused Disk\Add To Pool it shows a list of disk and gives me the options Add Disks to: New Pool or Existing Pool. If I choose existing, it list my 4 pools and once I choose a pool the only option is to Add Disks. There is no option to assign the appropriate disk to the assigned pool.

I am afraid if I choose Add Disk it will add all of them to the one pool selected. Everything reports correctly under Usage: Usable Capacity, Used & Available.

I’m not sure how to fix this. On a previous upgrade I had a similar experience and eventually over time the system recognized the disk as being assigned and removed them from the Unused disk list.

Thanks in advance for any insight.

Mark

joeschmuck · November 9, 2024, 3:14pm

Choose the Import option. To the right of the screen I believe.

markperron · November 9, 2024, 4:43pm

Thank You for the help Old Man and Go Dawgs! I don’t see the option to import.

I tried to attach some images to help clarify but it wouldn’t allow me. Is there a way to attach pictures?

neofusion · November 9, 2024, 4:46pm

It should be in the upper right corner, like in this screenshot from the official docs:

markperron · November 9, 2024, 5:10pm

neofusion · November 9, 2024, 5:13pm

Why are you pressing Add to pool (which will wipe the drives) when the Import button is right there in the upper right corner of your first screenshot…?

markperron · November 9, 2024, 5:16pm

Thank You Neofusion. It doesn’t give me any options under add to pool. See image.

neofusion · November 9, 2024, 5:20pm

In that case I’m sorry to say that I don’t know why your drives would show up like that.
“Add to pool” will wipe the drives, so that is definitely not the ideal choice.

I don’t suppose TrueNAS is running in a VM or something like that?

markperron · November 9, 2024, 5:23pm

No VM or anything out of the ordinary other than what it is showing. All works fine. Thanks for trying to help.

Soukyuu · November 19, 2024, 10:34am

I have a similar issue and I have a hunch: the pool was created in 24.10.0.2, raidz1, 4x4TB disks, TrueNAS claimed disks will be wiped. Right after the creation, 2x of the HDDs were shown as unused.

I managed to fix that by exporting and re-importing the pool. However, after a couple of restarts one of the disks re-appeared as unused.

Looking at the pool with zpool status, it shows two of the disks were added as /dev/sdd and /dev/sde. Now, if on boot one of the other two disks takes that spot, then obviously, zfs will have troubles detecting the “correct” disk.

Question is, why is trueNAS adding disks by /dev/sdX, something that is explicitly discouraged?

bacon · November 19, 2024, 1:07pm

Please post the output of the following commands:

sudo zpool status
sudo blkid
sudo lsblk

Soukyuu · November 20, 2024, 8:33am

$ sudo zpool status
  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:07 with 0 errors on Mon Nov 18 12:45:09 2024
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          sda3      ONLINE       0     0     0

errors: No known data errors

  pool: vault
 state: ONLINE
  scan: scrub repaired 0B in 01:14:11 with 0 errors on Tue Nov 19 11:44:23 2024
config:

        NAME                                      STATE     READ WRITE CKSUM
        vault                                     ONLINE       0     0     0
          raidz1-0                                ONLINE       0     0     0
            5730a93f-1716-4701-986a-d8b54c40e865  ONLINE       0     0     0
            sde1                                  ONLINE       0     0     0
            sdd1                                  ONLINE       0     0     0
            b1d975ef-da34-47b2-be48-4379177711d3  ONLINE       0     0     0

errors: No known data errors

$ sudo blkid
/dev/sdb1: LABEL="vault" UUID="5397978179880101329" UUID_SUB="1783323184070354137" BLOCK_SIZE="4096" TYPE="zfs_member" PARTLABEL="data" PARTUUID="5730a93f-1716-4701-986a-d8b54c40e865"
/dev/sdc1: LABEL="vault" UUID="5397978179880101329" UUID_SUB="9540862323159506122" BLOCK_SIZE="4096" TYPE="zfs_member" PARTLABEL="data" PARTUUID="b1d975ef-da34-47b2-be48-4379177711d3"
/dev/sda2: LABEL_FATBOOT="EFI" LABEL="EFI" UUID="5033-3D06" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="2ec028bf-01e8-47b5-97e8-874594d381bb"
/dev/sda3: LABEL="boot-pool" UUID="17731628296780827910" UUID_SUB="3586388745946352903" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="d03a8beb-621a-4fe3-813b-0fc0e8e03dad"
/dev/sda1: PARTUUID="cbe1cfab-c431-4682-ba2d-de35893d9f1c"

$ sudo lsblk
NAME   MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTS
sda      8:0    0   16G  0 disk 
├─sda1   8:1    0    1M  0 part 
├─sda2   8:2    0  512M  0 part 
└─sda3   8:3    0 15.5G  0 part 
sdb      8:16   0  3.6T  0 disk 
└─sdb1   8:17   0  3.6T  0 part 
sdc      8:32   0  3.6T  0 disk 
└─sdc1   8:33   0  3.6T  0 part 
sdd      8:48   0  3.6T  0 disk 
└─sdd1   8:49   0  3.6T  0 part 
sde      8:64   0  3.6T  0 disk 
└─sde1   8:65   0  3.6T  0 part

bacon · November 20, 2024, 9:00am

Some of your devices aren’t recognized by blkid. This usually happens if there are leftovers from other file systems on those devices.

Please run and post the output of following commands against the partitions that aren’t listed in blkid.

blkid --probe /dev/sdX1
wipefs /dev/sdX1

markperron · November 20, 2024, 1:57pm

Hello and thank you for your help. Mark

NAME STATE READ WRITE CKSUM
Applications ONLINE 0 0 0
630bdd82-faf2-4c3e-bb6e-fd3552452a45 ONLINE 0 0 0

errors: No known data errors

pool: Data
state: ONLINE
scan: scrub repaired 0B in 01:54:06 with 0 errors on Sun Oct 20 01:54:07 2024
config:

    NAME                                      STATE     READ WRITE CKSUM
    Data                                      ONLINE       0     0     0
      raidz3-0                                ONLINE       0     0     0
        29f4452f-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a4f4da6-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2aabce0b-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a913b53-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a4d2992-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a65d7f7-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a934d64-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a9833dc-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2a5a0a6a-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2e722e3e-3132-4aa0-89ec-914ee29fa8d6  ONLINE       0     0     0
        2aa004a9-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        2aa9ba4e-eaf9-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0

errors: No known data errors

pool: Movies
state: ONLINE
scan: scrub repaired 0B in 06:53:02 with 0 errors on Tue Oct 29 19:37:55 2024
config:

    NAME                                      STATE     READ WRITE CKSUM
    Movies                                    ONLINE       0     0     0
      raidz3-0                                ONLINE       0     0     0
        d1eb8141-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        cf1a96d0-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d1f5d0d7-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d219ce47-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d2255213-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        cf37d28a-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d23dd221-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d2c41898-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d20c9660-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d1c4a861-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d201ae53-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0
        d230003a-eaf8-11ee-8f35-ac1f6bb00df8  ONLINE       0     0     0

errors: No known data errors

pool: Temp Storage
state: ONLINE
scan: scrub repaired 0B in 00:00:02 with 0 errors on Sun Oct 20 00:00:03 2024
config:

    NAME                                    STATE     READ WRITE CKSUM
    Temp Storage                            ONLINE       0     0     0
      1fde13e6-cc6a-40c5-bb4a-4c92a56af7aa  ONLINE       0     0     0

errors: No known data errors

pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:48 with 0 errors on Sat Nov 16 03:45:50 2024
config:

    NAME        STATE     READ WRITE CKSUM
    boot-pool   ONLINE       0     0     0
      sdav3     ONLINE       0     0     0

errors: No known data errors
admin@truenas[~]$ sudo blkid
/dev/sdy2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“10186822818069556277” TYPE=“zfs_member” PARTUUID=“d23dd221-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdam2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“4231488984435547451” TYPE=“zfs_member” PARTUUID=“2a934d64-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdf2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“2377635160077504291” TYPE=“zfs_member” PARTUUID=“d219ce47-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdau2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“2563632851954670528” TYPE=“zfs_member” PARTUUID=“2a5a0a6a-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdab2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“2377635160077504291” TYPE=“zfs_member” PARTUUID=“d219ce47-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/nvme0n1p1: LABEL=“Applications” UUID=“12561176887251919572” UUID_SUB=“10481254464040787212” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“630bdd82-faf2-4c3e-bb6e-fd3552452a45”
/dev/sdo2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“17531895033482683188” TYPE=“zfs_member” PARTUUID=“2a9833dc-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdw2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“10500780909979512097” TYPE=“zfs_member” PARTUUID=“d2255213-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdak2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“4921903048326568594” TYPE=“zfs_member” PARTUUID=“2a913b53-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdd2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“1045479109172129687” TYPE=“zfs_member” PARTUUID=“cf1a96d0-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdas2: LABEL_FATBOOT=“EFI” LABEL=“EFI” UUID=“B431-38B1” BLOCK_SIZE=“512” TYPE=“vfat” PARTUUID=“d9306a3e-df5b-4fab-a0bc-4eb9cd977034”
/dev/sdas3: LABEL=“boot-pool” UUID=“2519822516437861898” UUID_SUB=“15116806107456262703” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“0a1390e8-e63e-4ec9-b0ad-67082dcb03c3”
/dev/sdm2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“6028113530752550424” TYPE=“zfs_member” PARTUUID=“2aa004a9-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdu2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“10493205711593817052” TYPE=“zfs_member” PARTUUID=“2aabce0b-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdai2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“6028113530752550424” TYPE=“zfs_member” PARTUUID=“2aa004a9-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdb2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11808549303409129673” TYPE=“zfs_member” PARTUUID=“d20c9660-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaq2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“10996508229431205234” TYPE=“zfs_member” PARTUUID=“2a4f4da6-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdk2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11603718591617314444” TYPE=“zfs_member” PARTUUID=“d1c4a861-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sds2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“11884531807968847757” TYPE=“zfs_member” PARTUUID=“2a4d2992-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdag2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11603718591617314444” TYPE=“zfs_member” PARTUUID=“d1c4a861-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdi2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11286594821037189275” TYPE=“zfs_member” PARTUUID=“d2c41898-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdax1: LABEL=“Temp Storage” UUID=“11305785363992075268” UUID_SUB=“4902281297943074809” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“1fde13e6-cc6a-40c5-bb4a-4c92a56af7aa”
/dev/sdq2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“10032270320317777038” TYPE=“zfs_member” PARTUUID=“29f4452f-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdae2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11286594821037189275” TYPE=“zfs_member” PARTUUID=“d2c41898-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdz2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“1045479109172129687” TYPE=“zfs_member” PARTUUID=“cf1a96d0-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdan2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“10493205711593817052” TYPE=“zfs_member” PARTUUID=“2aabce0b-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdg2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“687594319756491725” TYPE=“zfs_member” PARTUUID=“d230003a-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdav2: LABEL_FATBOOT=“EFI” LABEL=“EFI” UUID=“BB9E-B1C1” BLOCK_SIZE=“512” TYPE=“vfat” PARTUUID=“129000a1-4791-4d09-9cb7-17df089f742f”
/dev/sdav3: LABEL=“boot-pool” UUID=“3405183060005337727” UUID_SUB=“6494188525155024432” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“55bae20e-529e-4be4-8882-ab51a7db634d”
/dev/sdac2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“8222079340760928994” TYPE=“zfs_member” PARTUUID=“cf37d28a-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdx2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“11808549303409129673” TYPE=“zfs_member” PARTUUID=“d20c9660-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdal2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“17531895033482683188” TYPE=“zfs_member” PARTUUID=“2a9833dc-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sde2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“8788864782625712258” TYPE=“zfs_member” PARTUUID=“d1eb8141-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdat2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“3660202780857776686” TYPE=“zfs_member” PARTUUID=“d1f5d0d7-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaa2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“8788864782625712258” TYPE=“zfs_member” PARTUUID=“d1eb8141-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdn2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“17901578124739634251” TYPE=“zfs_member” PARTUUID=“2a65d7f7-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdv2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“3660202780857776686” TYPE=“zfs_member” PARTUUID=“d1f5d0d7-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaj2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“17901578124739634251” TYPE=“zfs_member” PARTUUID=“2a65d7f7-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdc2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“10186822818069556277” TYPE=“zfs_member” PARTUUID=“d23dd221-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdar1: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“9407973802837559495” TYPE=“zfs_member” PARTUUID=“2e722e3e-3132-4aa0-89ec-914ee29fa8d6”
/dev/sdl2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“11453341544526602658” TYPE=“zfs_member” PARTUUID=“2aa9ba4e-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdt2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“4921903048326568594” TYPE=“zfs_member” PARTUUID=“2a913b53-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdah2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“11453341544526602658” TYPE=“zfs_member” PARTUUID=“2aa9ba4e-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sda2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“10500780909979512097” TYPE=“zfs_member” PARTUUID=“d2255213-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdap2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“11884531807968847757” TYPE=“zfs_member” PARTUUID=“2a4d2992-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdj2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“4128177596666963344” TYPE=“zfs_member” PARTUUID=“d201ae53-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sday2: LABEL_FATBOOT=“EFI” LABEL=“EFI” UUID=“C1A3-4C9A” BLOCK_SIZE=“512” TYPE=“vfat” PARTUUID=“b09f0601-dc3d-4c28-bf04-6343d7ea9148”
/dev/sday3: LABEL=“boot-pool” UUID=“17482514890861656792” UUID_SUB=“18127651123707622384” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“4448941b-1a4b-4d4d-8c2b-a454473aa135”
/dev/sdr1: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“9407973802837559495” TYPE=“zfs_member” PARTUUID=“2e722e3e-3132-4aa0-89ec-914ee29fa8d6”
/dev/sdaf2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“4128177596666963344” TYPE=“zfs_member” PARTUUID=“d201ae53-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdao2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“10032270320317777038” TYPE=“zfs_member” PARTUUID=“29f4452f-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdh2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“8222079340760928994” TYPE=“zfs_member” PARTUUID=“cf37d28a-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaw2: LABEL=“Ripped” BLOCK_SIZE=“512” UUID=“F6401BEF401BB579” TYPE=“ntfs” PARTLABEL=“Basic data partition” PARTUUID=“6959dd9a-1f45-4f62-b1f2-fec8cf1da983”
/dev/sdp2: LABEL=“Data” UUID=“14259901810027186667” UUID_SUB=“4231488984435547451” TYPE=“zfs_member” PARTUUID=“2a934d64-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdad2: LABEL=“Movies” UUID=“4740610090080866199” UUID_SUB=“687594319756491725” TYPE=“zfs_member” PARTUUID=“d230003a-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdy1: PARTUUID=“d13dc638-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdam1: PARTUUID=“29db741f-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdf1: PARTUUID=“d10aaa15-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdau1: PARTUUID=“29ad0cb6-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdab1: PARTUUID=“d10aaa15-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdo1: PARTUUID=“29eca1f7-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdw1: PARTUUID=“d0ffa2cd-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdak1: PARTUUID=“29e8ef5b-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdd1: PARTUUID=“cebe0037-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdas4: PARTUUID=“675978e7-4e61-40c7-9242-6b18d3c1f4ed”
/dev/sdas1: PARTUUID=“733a9adf-a715-48ca-b966-2499b284b564”
/dev/sdm1: PARTUUID=“29dd10dc-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdu1: PARTUUID=“29e72228-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdai1: PARTUUID=“29dd10dc-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdb1: PARTUUID=“d123c15b-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaq1: PARTUUID=“2996c2c9-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdk1: PARTUUID=“d0e00084-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sds1: PARTUUID=“299ef8d4-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdag1: PARTUUID=“d0e00084-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdi1: PARTUUID=“d1bc050e-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdq1: PARTUUID=“298c5058-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdae1: PARTUUID=“d1bc050e-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdz1: PARTUUID=“cebe0037-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdan1: PARTUUID=“29e72228-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdg1: PARTUUID=“d12f8b29-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdav4: PARTUUID=“ae7a139e-7466-431c-bc99-94fd3d9c2626”
/dev/sdav1: PARTUUID=“878c44ed-0a56-4577-96f6-9007e4a8c9aa”
/dev/sdac1: PARTUUID=“cee01b69-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdx1: PARTUUID=“d123c15b-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdal1: PARTUUID=“29eca1f7-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sde1: PARTUUID=“d118aaf9-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdat1: PARTUUID=“d0f432e4-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaa1: PARTUUID=“d118aaf9-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdn1: PARTUUID=“29a40306-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdv1: PARTUUID=“d0f432e4-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaj1: PARTUUID=“29a40306-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdc1: PARTUUID=“d13dc638-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdl1: PARTUUID=“29f63da9-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdt1: PARTUUID=“29e8ef5b-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdah1: PARTUUID=“29f63da9-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sda1: PARTUUID=“d0ffa2cd-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdap1: PARTUUID=“299ef8d4-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdj1: PARTUUID=“d146db71-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sday1: PARTUUID=“ba182eec-2c3d-4d4d-aa1b-de4ed8b7c2a2”
/dev/sday4: PARTUUID=“e34c06e3-28b0-4920-9452-d584e9a03d3b”
/dev/sdaf1: PARTUUID=“d146db71-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdao1: PARTUUID=“298c5058-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdh1: PARTUUID=“cee01b69-eaf8-11ee-8f35-ac1f6bb00df8”
/dev/sdaw1: PARTLABEL=“Microsoft reserved partition” PARTUUID=“c9fdecbd-8f35-11e6-ab88-001374000000”
/dev/sdp1: PARTUUID=“29db741f-eaf9-11ee-8f35-ac1f6bb00df8”
/dev/sdad1: PARTUUID=“d12f8b29-eaf8-11ee-8f35-ac1f6bb00df8”
admin@truenas[~]$ sudo lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 10.9T 0 disk
├─sda1 8:1 0 2G 0 part
└─sda2 8:2 0 10.9T 0 part
sdb 8:16 0 7.3T 0 disk
├─sdb1 8:17 0 2G 0 part
└─sdb2 8:18 0 7.3T 0 part
sdc 8:32 0 7.3T 0 disk
├─sdc1 8:33 0 2G 0 part
└─sdc2 8:34 0 7.3T 0 part
sdd 8:48 0 10.9T 0 disk
├─sdd1 8:49 0 2G 0 part
└─sdd2 8:50 0 10.9T 0 part
sde 8:64 0 7.3T 0 disk
├─sde1 8:65 0 2G 0 part
└─sde2 8:66 0 7.3T 0 part
sdf 8:80 0 10.9T 0 disk
├─sdf1 8:81 0 2G 0 part
└─sdf2 8:82 0 10.9T 0 part
sdg 8:96 0 7.3T 0 disk
├─sdg1 8:97 0 2G 0 part
└─sdg2 8:98 0 7.3T 0 part
sdh 8:112 0 10.9T 0 disk
├─sdh1 8:113 0 2G 0 part
└─sdh2 8:114 0 10.9T 0 part
sdi 8:128 0 7.3T 0 disk
├─sdi1 8:129 0 2G 0 part
└─sdi2 8:130 0 7.3T 0 part
sdj 8:144 0 10.9T 0 disk
├─sdj1 8:145 0 2G 0 part
└─sdj2 8:146 0 10.9T 0 part
sdk 8:160 0 7.3T 0 disk
├─sdk1 8:161 0 2G 0 part
└─sdk2 8:162 0 7.3T 0 part
sdl 8:176 0 5.5T 0 disk
├─sdl1 8:177 0 2G 0 part
└─sdl2 8:178 0 5.5T 0 part
sdm 8:192 0 5.5T 0 disk
├─sdm1 8:193 0 2G 0 part
└─sdm2 8:194 0 5.5T 0 part
sdn 8:208 0 7.3T 0 disk
├─sdn1 8:209 0 2G 0 part
└─sdn2 8:210 0 7.3T 0 part
sdo 8:224 0 7.3T 0 disk
├─sdo1 8:225 0 2G 0 part
└─sdo2 8:226 0 7.3T 0 part
sdp 8:240 0 5.5T 0 disk
├─sdp1 8:241 0 2G 0 part
└─sdp2 8:242 0 5.5T 0 part
sdq 65:0 0 5.5T 0 disk
├─sdq1 65:1 0 2G 0 part
└─sdq2 65:2 0 5.5T 0 part
sdr 65:16 0 7.3T 0 disk
└─sdr1 65:17 0 5.5T 0 part
sds 65:32 0 7.3T 0 disk
├─sds1 65:33 0 2G 0 part
└─sds2 65:34 0 7.3T 0 part
sdt 65:48 0 5.5T 0 disk
├─sdt1 65:49 0 2G 0 part
└─sdt2 65:50 0 5.5T 0 part
sdu 65:64 0 5.5T 0 disk
├─sdu1 65:65 0 2G 0 part
└─sdu2 65:66 0 5.5T 0 part
sdv 65:80 0 10.9T 0 disk
├─sdv1 65:81 0 2G 0 part
└─sdv2 65:82 0 10.9T 0 part
sdw 65:96 0 10.9T 0 disk
├─sdw1 65:97 0 2G 0 part
└─sdw2 65:98 0 10.9T 0 part
sdx 65:112 0 7.3T 0 disk
├─sdx1 65:113 0 2G 0 part
└─sdx2 65:114 0 7.3T 0 part
sdy 65:128 0 7.3T 0 disk
├─sdy1 65:129 0 2G 0 part
└─sdy2 65:130 0 7.3T 0 part
sdz 65:144 0 10.9T 0 disk
├─sdz1 65:145 0 2G 0 part
└─sdz2 65:146 0 10.9T 0 part
sdaa 65:160 0 7.3T 0 disk
├─sdaa1 65:161 0 2G 0 part
└─sdaa2 65:162 0 7.3T 0 part
sdab 65:176 0 10.9T 0 disk
├─sdab1 65:177 0 2G 0 part
└─sdab2 65:178 0 10.9T 0 part
sdac 65:192 0 10.9T 0 disk
├─sdac1 65:193 0 2G 0 part
└─sdac2 65:194 0 10.9T 0 part
sdad 65:208 0 7.3T 0 disk
├─sdad1 65:209 0 2G 0 part
└─sdad2 65:210 0 7.3T 0 part
sdae 65:224 0 7.3T 0 disk
├─sdae1 65:225 0 2G 0 part
└─sdae2 65:226 0 7.3T 0 part
sdaf 65:240 0 10.9T 0 disk
├─sdaf1 65:241 0 2G 0 part
└─sdaf2 65:242 0 10.9T 0 part
sdag 66:0 0 7.3T 0 disk
├─sdag1 66:1 0 2G 0 part
└─sdag2 66:2 0 7.3T 0 part
sdah 66:16 0 5.5T 0 disk
├─sdah1 66:17 0 2G 0 part
└─sdah2 66:18 0 5.5T 0 part
sdai 66:32 0 5.5T 0 disk
├─sdai1 66:33 0 2G 0 part
└─sdai2 66:34 0 5.5T 0 part
sdaj 66:48 0 7.3T 0 disk
├─sdaj1 66:49 0 2G 0 part
└─sdaj2 66:50 0 7.3T 0 part
sdak 66:64 0 5.5T 0 disk
├─sdak1 66:65 0 2G 0 part
└─sdak2 66:66 0 5.5T 0 part
sdal 66:80 0 7.3T 0 disk
├─sdal1 66:81 0 2G 0 part
└─sdal2 66:82 0 7.3T 0 part
sdam 66:96 0 5.5T 0 disk
├─sdam1 66:97 0 2G 0 part
└─sdam2 66:98 0 5.5T 0 part
sdan 66:112 0 5.5T 0 disk
├─sdan1 66:113 0 2G 0 part
└─sdan2 66:114 0 5.5T 0 part
sdao 66:128 0 5.5T 0 disk
├─sdao1 66:129 0 2G 0 part
└─sdao2 66:130 0 5.5T 0 part
sdap 66:144 0 7.3T 0 disk
├─sdap1 66:145 0 2G 0 part
└─sdap2 66:146 0 7.3T 0 part
sdaq 66:160 0 5.5T 0 disk
├─sdaq1 66:161 0 2G 0 part
└─sdaq2 66:162 0 5.5T 0 part
sdar 66:176 0 7.3T 0 disk
└─sdar1 66:177 0 5.5T 0 part
sdas 66:192 0 465.8G 0 disk
├─sdas1 66:193 0 1M 0 part
├─sdas2 66:194 0 512M 0 part
├─sdas3 66:195 0 449.3G 0 part
└─sdas4 66:196 0 16G 0 part
sdat 66:208 0 10.9T 0 disk
├─sdat1 66:209 0 2G 0 part
└─sdat2 66:210 0 10.9T 0 part
sdau 66:224 0 5.5T 0 disk
├─sdau1 66:225 0 2G 0 part
└─sdau2 66:226 0 5.5T 0 part
sdav 66:240 0 223.6G 0 disk
├─sdav1 66:241 0 1M 0 part
├─sdav2 66:242 0 512M 0 part
├─sdav3 66:243 0 207.1G 0 part
└─sdav4 66:244 0 16G 0 part
sdaw 67:0 0 465.8G 0 disk
├─sdaw1 67:1 0 128M 0 part
└─sdaw2 67:2 0 465.6G 0 part
sdax 67:16 0 18.2T 0 disk
└─sdax1 67:17 0 18.2T 0 part
sday 67:32 0 232.9G 0 disk
├─sday1 67:33 0 1M 0 part
├─sday2 67:34 0 512M 0 part
├─sday3 67:35 0 216.4G 0 part
└─sday4 67:36 0 16G 0 part
nvme0n1 259:0 0 465.8G 0 disk
└─nvme0n1p1 259:1 0 465.8G 0 part
admin@truenas[~]$

bacon · November 20, 2024, 2:21pm

@Soukyuu your issue is unrelated the issue that @markperron is having. Could you perhaps open seperate thread?

@markperron Looks like each of your disks is listed twice. For example sdl2 and sdah2 are identical. You said you have 25 drives, but lsblk is listing 50. Please do not try to add any “unused” devices to the pool.

I think in order to avoid that we would need to know the details of your system. Especially how the drives are connected to the system. I think the output of lspci -v would be helpful as well.

EDIT: I noticed you posted some system details in the first post.

etorix · November 20, 2024, 4:06pm

25 drives on a -16i HBA implies some SAS expander.
50 drives listed for 25 physical drives suggest there’s a multipath issue.
Check cabling and remove multipath.

markperron · November 20, 2024, 4:24pm

Hello Etorix, please let me know what additional you need. Kind Regards.

Supermicro A2SDi-16C-HLN4F, Supermicro BPN-SAS3-846EL2 4U 24-Bay SAS/SATA Dual Expander Backplane, LSI SAS 9300-16i RAID Controller Card 12Gb/S HBA Bus Adapter IT Mode PCIe Expander Card + 4*SFF-8643 SATA Cable

Linux truenas 6.6.44-production+truenas #1 SMP PREEMPT_DYNAMIC Fri Nov 8 18:37:36 UTC 2024 x86_64

    TrueNAS (c) 2009-2024, iXsystems, Inc.
    All rights reserved.
    TrueNAS code is released under the LGPLv3 and GPLv3 licenses with some
    source files copyrighted by (c) iXsystems, Inc. All other components
    are released under their own respective licenses.

    For more information, documentation, help or support, go here:
    http://truenas.com

Welcome to TrueNAS
Last login: Wed Nov 20 08:04:39 PST 2024 on pts/1

Warning: the supported mechanisms for making configuration changes
are the TrueNAS WebUI, CLI, and API exclusively. ALL OTHERS ARE
NOT SUPPORTED AND WILL RESULT IN UNDEFINED BEHAVIOR AND MAY
RESULT IN SYSTEM FAILURE.

admin@truenas[~]$ lspci -v
00:00.0 Host bridge: Intel Corporation Atom Processor C3000 Series System Agent (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series System Agent
Flags: bus master, fast devsel, latency 0, IOMMU group 0

00:04.0 Host bridge: Intel Corporation Atom Processor C3000 Series Error Registers (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series Error Registers
Flags: fast devsel, IOMMU group 1
Capabilities:

00:05.0 Generic system peripheral [0807]: Intel Corporation Atom Processor C3000 Series Root Complex Event Collector (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series Root Complex Event Collector
Flags: bus master, fast devsel, latency 0, IRQ 25, IOMMU group 2
Capabilities:
Kernel driver in use: pcieport

00:09.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #0 (rev 11) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series PCI Express Root Port
Flags: bus master, fast devsel, latency 0, IRQ 26, IOMMU group 3
Memory at df940000 (64-bit, non-prefetchable) [size=128K]
Bus: primary=00, secondary=01, subordinate=05, sec-latency=0
I/O behind bridge: b000-cfff [size=8K] [16-bit]
Memory behind bridge: df100000-df5fffff [size=5M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

00:10.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #6 (rev 11) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series PCI Express Root Port
Flags: bus master, fast devsel, latency 0, IRQ 27, IOMMU group 4
Memory at df920000 (64-bit, non-prefetchable) [size=128K]
Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
I/O behind bridge: [disabled] [16-bit]
Memory behind bridge: df800000-df8fffff [size=1M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

00:11.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #7 (rev 11) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series PCI Express Root Port
Flags: bus master, fast devsel, latency 0, IRQ 28, IOMMU group 5
Memory at df900000 (64-bit, non-prefetchable) [size=128K]
Bus: primary=00, secondary=07, subordinate=08, sec-latency=0
I/O behind bridge: d000-dfff [size=4K] [16-bit]
Memory behind bridge: de000000-df0fffff [size=17M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

00:12.0 System peripheral: Intel Corporation Atom Processor C3000 Series SMBus Contoller - Host (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series SMBus Contoller - Host
Flags: bus master, fast devsel, latency 0, IRQ 34, IOMMU group 6
Memory at df97e000 (64-bit, non-prefetchable) [size=1K]
Capabilities:
Kernel driver in use: ismt_smbus
Kernel modules: i2c_ismt

00:13.0 SATA controller: Intel Corporation Atom Processor C3000 Series SATA Controller 0 (rev 11) (prog-if 01 [AHCI 1.0])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series SATA Controller 0
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 20, IOMMU group 7
Memory at df976000 (32-bit, non-prefetchable) [size=8K]
Memory at df97d000 (32-bit, non-prefetchable) [size=256]
I/O ports at e090 [size=8]
I/O ports at e080 [size=4]
I/O ports at e040 [size=32]
Memory at df97c000 (32-bit, non-prefetchable) [size=2K]
Capabilities:
Kernel driver in use: ahci
Kernel modules: ahci

00:14.0 SATA controller: Intel Corporation Atom Processor C3000 Series SATA Controller 1 (rev 11) (prog-if 01 [AHCI 1.0])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series SATA Controller 1
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 21, IOMMU group 8
Memory at df974000 (32-bit, non-prefetchable) [size=8K]
Memory at df97b000 (32-bit, non-prefetchable) [size=256]
I/O ports at e070 [size=8]
I/O ports at e060 [size=4]
I/O ports at e020 [size=32]
Memory at df97a000 (32-bit, non-prefetchable) [size=2K]
Capabilities:
Kernel driver in use: ahci
Kernel modules: ahci

00:15.0 USB controller: Intel Corporation Atom Processor C3000 Series USB 3.0 xHCI Controller (rev 11) (prog-if 30 [XHCI])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series USB 3.0 xHCI Controller
Flags: bus master, medium devsel, latency 0, IRQ 36, IOMMU group 9
Memory at df960000 (64-bit, non-prefetchable) [size=64K]
Capabilities:
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci

00:16.0 PCI bridge: Intel Corporation Atom Processor C3000 Series Integrated LAN Root Port #0 (rev 11) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series Integrated LAN Root Port
Flags: bus master, fast devsel, latency 0, IRQ 29, IOMMU group 10
Bus: primary=00, secondary=09, subordinate=09, sec-latency=0
I/O behind bridge: [disabled] [16-bit]
Memory behind bridge: 80000000-804fffff [size=5M] [32-bit]
Prefetchable memory behind bridge: dda00000-ddefffff [size=5M] [32-bit]
Capabilities:
Kernel driver in use: pcieport

00:17.0 PCI bridge: Intel Corporation Atom Processor C3000 Series Integrated LAN Root Port #1 (rev 11) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series Integrated LAN Root Port
Flags: bus master, fast devsel, latency 0, IRQ 30, IOMMU group 11
Bus: primary=00, secondary=0a, subordinate=0a, sec-latency=0
I/O behind bridge: [disabled] [16-bit]
Memory behind bridge: 80500000-809fffff [size=5M] [32-bit]
Prefetchable memory behind bridge: dd400000-dd8fffff [size=5M] [32-bit]
Capabilities:
Kernel driver in use: pcieport

00:18.0 Communication controller: Intel Corporation Atom Processor C3000 Series ME HECI 1 (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series ME HECI 1
Flags: bus master, fast devsel, latency 0, IRQ 255, IOMMU group 12
Memory at df979000 (64-bit, non-prefetchable) [size=4K]
Capabilities:

00:1f.0 ISA bridge: Intel Corporation Atom Processor C3000 Series LPC or eSPI (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series LPC or eSPI
Flags: bus master, medium devsel, latency 0, IOMMU group 13

00:1f.2 Memory controller: Intel Corporation Atom Processor C3000 Series Power Management Controller (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series Power Management Controller
Flags: fast devsel, IOMMU group 13
Memory at df970000 (32-bit, non-prefetchable) [disabled] [size=16K]

00:1f.4 SMBus: Intel Corporation Atom Processor C3000 Series SMBus controller (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series SMBus controller
Flags: medium devsel, IRQ 23, IOMMU group 13
Memory at df978000 (64-bit, non-prefetchable) [size=256]
I/O ports at e000 [size=32]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801

00:1f.5 Serial bus controller: Intel Corporation Atom Processor C3000 Series SPI Controller (rev 11)
Subsystem: Super Micro Computer Inc Atom Processor C3000 Series SPI Controller
Flags: fast devsel, IOMMU group 13
Memory at fe010000 (32-bit, non-prefetchable) [size=4K]

01:00.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 14
Memory at df500000 (32-bit, non-prefetchable) [size=256K]
Bus: primary=01, secondary=02, subordinate=05, sec-latency=0
I/O behind bridge: b000-cfff [size=8K] [16-bit]
Memory behind bridge: df100000-df4fffff [size=4M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

02:00.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA
Flags: bus master, fast devsel, latency 0, IRQ 31, IOMMU group 15
Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: c000-cfff [size=4K] [16-bit]
Memory behind bridge: df300000-df4fffff [size=2M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

02:08.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA
Flags: bus master, fast devsel, latency 0, IRQ 32, IOMMU group 16
Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
I/O behind bridge: [disabled] [32-bit]
Memory behind bridge: [disabled] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

02:09.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA
Flags: bus master, fast devsel, latency 0, IRQ 33, IOMMU group 17
Bus: primary=02, secondary=05, subordinate=05, sec-latency=0
I/O behind bridge: b000-bfff [size=4K] [16-bit]
Memory behind bridge: df100000-df2fffff [size=2M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:
Kernel driver in use: pcieport

03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)
Subsystem: Broadcom / LSI SAS 9300-16i
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 18
I/O ports at c000 [size=256]
Memory at df400000 (64-bit, non-prefetchable) [size=64K]
Expansion ROM at df300000 [disabled] [size=1M]
Capabilities:
Kernel driver in use: mpt3sas
Kernel modules: mpt3sas

05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)
Subsystem: Broadcom / LSI SAS 9300-16i
Flags: bus master, fast devsel, latency 0, IRQ 17, IOMMU group 19
I/O ports at b000 [size=256]
Memory at df200000 (64-bit, non-prefetchable) [size=64K]
Expansion ROM at df100000 [disabled] [size=1M]
Capabilities:
Kernel driver in use: mpt3sas
Kernel modules: mpt3sas

06:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 (prog-if 02 [NVM Express])
Subsystem: Samsung Electronics Co Ltd SSD 970 EVO
Flags: bus master, fast devsel, latency 0, IRQ 22, IOMMU group 20
Memory at df800000 (64-bit, non-prefetchable) [size=16K]
Capabilities:
Kernel driver in use: nvme
Kernel modules: nvme

07:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03) (prog-if 00 [Normal decode])
Subsystem: Super Micro Computer Inc AST1150 PCI-to-PCI Bridge
Flags: bus master, fast devsel, latency 0, IOMMU group 21
Bus: primary=07, secondary=08, subordinate=08, sec-latency=32
I/O behind bridge: d000-dfff [size=4K] [16-bit]
Memory behind bridge: de000000-df0fffff [size=17M] [32-bit]
Prefetchable memory behind bridge: [disabled] [64-bit]
Capabilities:

08:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 30) (prog-if 00 [VGA controller])
DeviceName: ASPEED Video AST2400
Subsystem: Super Micro Computer Inc ASPEED Graphics Family
Flags: medium devsel, IRQ 23, IOMMU group 21
Memory at de000000 (32-bit, non-prefetchable) [size=16M]
Memory at df000000 (32-bit, non-prefetchable) [size=128K]
I/O ports at d000 [size=128]
Capabilities:
Kernel driver in use: ast
Kernel modules: ast

09:00.0 Ethernet controller: Intel Corporation Ethernet Connection X553 1GbE (rev 11)
DeviceName: Intel Ethernet X553 SGMII #1
Subsystem: Intel Corporation Ethernet Connection X553 1GbE
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 22
Memory at ddc00000 (64-bit, prefetchable) [size=2M]
Memory at dde04000 (64-bit, prefetchable) [size=16K]
Expansion ROM at 80000000 [disabled] [size=512K]
Capabilities:
Kernel driver in use: ixgbe
Kernel modules: ixgbe

09:00.1 Ethernet controller: Intel Corporation Ethernet Connection X553 1GbE (rev 11)
DeviceName: Intel Ethernet X553 SGMII #2
Subsystem: Intel Corporation Ethernet Connection X553 1GbE
Flags: bus master, fast devsel, latency 0, IRQ 17, IOMMU group 23
Memory at dda00000 (64-bit, prefetchable) [size=2M]
Memory at dde00000 (64-bit, prefetchable) [size=16K]
Expansion ROM at 80080000 [disabled] [size=512K]
Capabilities:
Kernel driver in use: ixgbe
Kernel modules: ixgbe

0a:00.0 Ethernet controller: Intel Corporation Ethernet Connection X553 1GbE (rev 11)
DeviceName: Intel Ethernet X553 SGMII #3
Subsystem: Intel Corporation Ethernet Connection X553 1GbE
Flags: bus master, fast devsel, latency 0, IRQ 17, IOMMU group 24
Memory at dd600000 (64-bit, prefetchable) [size=2M]
Memory at dd804000 (64-bit, prefetchable) [size=16K]
Expansion ROM at 80500000 [disabled] [size=512K]
Capabilities:
Kernel driver in use: ixgbe
Kernel modules: ixgbe

0a:00.1 Ethernet controller: Intel Corporation Ethernet Connection X553 1GbE (rev 11)
DeviceName: Intel Ethernet X553 SGMII #4
Subsystem: Intel Corporation Ethernet Connection X553 1GbE
Flags: bus master, fast devsel, latency 0, IRQ 18, IOMMU group 25
Memory at dd400000 (64-bit, prefetchable) [size=2M]
Memory at dd800000 (64-bit, prefetchable) [size=16K]
Expansion ROM at 80580000 [disabled] [size=512K]
Capabilities:
Kernel driver in use: ixgbe
Kernel modules: ixgbe

admin@truenas[~]$
admin@truenas[~]$

bacon · November 20, 2024, 6:22pm

Looking at the backplane manual: You should only two cables from the HBA to the backplane ports J52 and J50. Currently you probably have four cables connected.

EDIT: Should be the two ports on J52 or the the ports of J50.

markperron · November 20, 2024, 8:53pm

You are brilliant. I unplugged the two right ones on each port and no longer have unused disk. I do have a 8tb disk missing/unplugged and I will figure out what connection issue I have there.

I am attaching a picture of the ports. Mine are labeled differently and show J50 & J49. So just to be clear I should be plugged into each port on left bank?

I greatly appreciate you solving this issue for me.

Mark

bacon · November 20, 2024, 9:10pm

I am not familiar with the backplane. I think I might have misread the manual.

The following might be the correct one: