Mirrored boot SSD showing as unassigned

Raising this again a bit more briefly to hopefully get some help identifying what could have gone wrong here.

I just migrated my nvmes to a new pool - no biggie, but I rebooted after as I needed to have a play around with k3s not mounting properly.

After rebooting, I’m seeing one of my two boot-pool devices showing as unassigned in the WebUI.

image

root@truenas[~]# zpool status boot-pool
  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:01:16 with 0 errors on Fri May 10 03:46:17 2024
config:

        NAME                                             STATE     READ WRITE CKSUM
        boot-pool                                        ONLINE       0     0     0
          mirror-0                                       ONLINE       0     0     0
            sdk3                                         ONLINE       0     0     0
            ata-INTEL_SSDSC2KF240H6L_CVLT646100S0240CGN  ONLINE       0     0     0

The device is ata-INTEL_SSDSC2KF240H6L_CVLT646100S0240CGN and the system at least sees it attached and online (although no idea why it’s showing up with this name instead of sdi3).

No alerts, no warnings, no other indication of issues. I tried to detach and reattach but it is just not having it:

root@truenas[~]# zpool detach boot-pool ata-INTEL_SSDSC2KF240H6L_CVLT646100S0240CGN
cannot detach ata-INTEL_SSDSC2KF240H6L_CVLT646100S0240CGN: no such device in pool
root@truenas[~]# zpool detach boot-pool /dev/sdi3
cannot detach /dev/sdi3: no such device in pool
root@truenas[~]#

Any ideas? Last time this happened I had to pull the drive out, detach it while it was missing from the system, then reattach it. Though I’d like to be able to figure out exactly why this is happening.

root@truenas[/var/log]# fdisk -l /dev/sdi
Disk /dev/sdi: 223.57 GiB, 240057409536 bytes, 468862128 sectors
Disk model: INTEL SSDSC2KF24
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
root@truenas[/var/log]#

I feel like this isn’t supposed to look like this.


Got it detached:

root@truenas[/var/log]# zpool detach boot-pool /dev/disk/by-id/ata-INTEL_SSDSC2KF240H6L_CVLT646100S0240CGN
root@truenas[~]# zpool attach boot-pool /dev/sdk3 /dev/sdi
root@truenas[~]# zpool status boot-pool
  pool: boot-pool
 state: ONLINE
status: One or more devices is currently being resilvered.  The pool will
        continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Sun May 12 14:01:27 2024
        29.4G / 29.4G scanned, 1.30G / 29.4G issued at 332M/s
        1.31G resilvered, 4.41% done, 00:01:26 to go
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          mirror-0  ONLINE       0     0     0
            sdk3    ONLINE       0     0     0
            sdi     ONLINE       0     0     0  (resilvering)

errors: No known data errors
root@truenas[~]#