Duplicated UUI after disk replacement

TrueNAS General
1

Hi all,

I’m operating truenas scale in version 25.04.2.4.
The storage consists of two pools with 2 disks each (mirrored).

I started expanding one of the pools with larger disks.
First I identified physically one of the disks which I
wanted to replace, set the disk offline via UI, replaced
the disk phyically and choosed replace via UI. Afterwards
I selected the new disk on UI and the resilvering process
started. Everything worked fine. After resilvering the pool
was healthy and I could see the larger disk part of the pool.

Next I tried the same with the second disk. I set the disk
offline, replaced the disk phyically and choosed replace via UI.
When I wanted to select the new disk a warning concerning
non-unique UUID was displayed. At this point I revoked the
last step, changed to the original, smaller disk and select
replace again. Resilvering started and at the end the pool was healthy
agein.

Unfortunately the UI does not display any details regarding the
new larger disk. Based on my analysis the reason is a duplicated UUI.

Output of blkid shows sdb1 and sdc1 with same UUID:

/dev/nvme0n1p1: UUID=“40f61bcd-a02d-2228-45a9-686b522947ca” UUID_SUB=“39d38ada-c514-6dee-3ca5-9a256c8267ca” LABEL=“swap0” TYPE=“linux_raid_member” PARTUUID=“1ed1519a-c720-11ee-93b3-88aedd62586a”
/dev/nvme0n1p2: LABEL=“trinity” UUID=“11643818934709794297” UUID_SUB=“11451933904279219078” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“1ed360dd-c720-11ee-93b3-88aedd62586a”
/dev/sdd2: LABEL=“trinity” UUID=“11643818934709794297” UUID_SUB=“2182835241038982062” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“1ef83b64-c720-11ee-93b3-88aedd62586a”
/dev/sdd1: UUID=“40f61bcd-a02d-2228-45a9-686b522947ca” UUID_SUB=“12ffbd28-b2bf-50af-b2c7-5a74ab249419” LABEL=“swap0” TYPE=“linux_raid_member” PARTUUID=“1eee1262-c720-11ee-93b3-88aedd62586a”
/dev/sdb1: LABEL=“tank” UUID=“7761288668386995723” UUID_SUB=“2715332628864299639” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“779d6600-9dea-4620-b040-79483ba3410c”
/dev/sde2: LABEL=“boot-pool” UUID=“12807414265011617825” UUID_SUB=“12652929424197985790” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“cb03ca45-c20d-11ee-9728-88aedd62586a”
/dev/sde1: SEC_TYPE=“msdos” UUID=“55B0-1C22” BLOCK_SIZE=“512” TYPE=“vfat” PARTUUID=“c9436136-c20d-11ee-9728-88aedd62586a”
/dev/sdc1: LABEL=“tank” UUID=“7761288668386995723” UUID_SUB=“10686244524266483011” BLOCK_SIZE=“4096” TYPE=“zfs_member” PARTUUID=“332b2d01-9142-4c04-be43-96d85d5da447”

ls -al /dev/disk/by-uuid/ shows that sdc1 is hidden:
total 0
drwxr-xr-x 2 root root 120 Mar 23 13:17 .
drwxr-xr-x 8 root root 160 Mar 23 13:16 ..
lrwxrwxrwx 1 root root 10 Mar 23 13:17 11643818934709794297 → ../../sdd2
lrwxrwxrwx 1 root root 10 Mar 23 13:16 12807414265011617825 → ../../sde2
lrwxrwxrwx 1 root root 10 Mar 23 13:16 55B0-1C22 → ../../sde1
lrwxrwxrwx 1 root root 10 Mar 23 13:17 7761288668386995723 → ../../sdb1

Does anybody have a recommendation for me what could be done in order to get disk sdb1 and sdc1 with different UUIDs?

2

SDB1 and SDC1 are part of the same pool, so having the same UUID is correct, think. At least it is that way in my raidz-pool.

What I find odd is having a swap partition with a linux_raid_member and a nvme + Sata in the same pool (trinity), and and sde1 is a mdos vfat? Are these leftovers on the disk from previous install? Maybe describe your setup/hardware a little more.

3

Ok, so my assumption the duplicated UUI is the root cause not seeing the details of the disk on truenas UI was totally wrong. Thank you for clarifying this. Do you have another idea why the UI does not display any details of /dev/sdc1 neither capacity nor anything else?

Output of the command lsblk -o type,name,label,partlabel,size,model,serial,wwn,uuid

disk sdc 1.8T ASM24 AAAABB
part └─sdc1
tank 929.5G 7761288668386995723

shows the larger disk.

Concerning your question, yes I think /dev/nvme0n1p1 must be a leftover which I was not aware of. /dev/sde1 is the USB device hosting the boot-pool. And finally, is that an issue mixing nvme and sata? I use this pool only for backups.

4

There is a known issue with duplicate serials (none) with USB drives. Do have more than one USB devices? The model ASM24 suggests asmedia, which do make usb to sata bridges and may explain the odd serial AAAABB.

5

Yes indeed I have two USB drives connected to the system. The one I already added to the pool “tank” by replacing an old one, and another one wich I also intended to add to the pool but haven’t done yet. When I disconnect the latter one I could see the details at the UI again. Many thanks for your help. But in consequence I could not use the second one, am I right?

1 Like
6

At the moment, yes.. Also, bear in mind that usb devices are not recommended as permanent devices in a pool. There’s an extensive discussion about the subject on this forum.