I lost my main 6-disk RAIDZ2 pool this night after two subsequent device got removed from the pool. It got from DEGRADED to SUSPENDED within 5mns as far as alerting emails can tell. The last email I got was pool state is SUSPENDED The following disks are not healthy (one is FAULTED, one is REMOVE…

[image] winnielinnie: The next step would be to reboot and run a full scrub on the pool. Rebooting will probably mean the pool doesn’t import as we never changed the state of the pool, we’re just browsing it at the previous state. @coolnodje if you know of any very recently modified files yo…

/dev/sda root@freenas[~]# smartctl -x /dev/sda smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build) Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Device Model: WDC WD122KRYZ-01CDAB0 …

[image] etorix: You might be another case of the mysterious “ZFS label eating bug at update time”. Once things cool down you can use /sbin/zdb -l /dev/sd<n> from the shell (System → Shell in the GUI) to examine the ZFS disk labels. Remember to look at partitions as well as the entire disk. Cu…

Sorry, yeah I meant 25.04 [image] PK1048: Have you turned the system off and let everything cool down? I did not. Something caused that drive to lose connectivity, at least for a time. The physical machine hasn’t been touched (that I know of), it was running in the basement. Can you sha…

[image] coolnodje: Something caused that drive to lose connectivity, at least for a time. The physical machine hasn’t been touched (that I know of), it was running in the basement. Can you share how you identify that? Do you mean the B002SNAD drive? Yes. Since that drive was marked REMOVE…

[image] PK1048: . But the first thing is remove one of the possible problems, the heat. All right, thanks, I will turn it off first. zdb -l /dev/sde1 zdb -l /dev/sdf1 both return information on LABEL 0

[image] coolnodje: both return information on LABEL 0 I love this game .

[image] coolnodje: Ok, do you suggest I do that now with the info I have? Yes. Click on the smiley face at top right, switch to “Report a bug” and send the debug information to iXsystems. And full output of zdb -l for all six drives in the pool please, not just the supposedly problematic one…

If you can supply us the output of zpool import in CODE tags without the pool name, we can see if their are additional problems beyond the 2 REMOVED disks. If the pool only has 2 REMOVED disks AND is RAID-Z2, then it is possible you just need to force import the pool. This is because ZFS does not …

[image] coolnodje: both return information on LABEL 0 What information? Was there a field identifying which of the four labels it found (0 1 2 3)? If the labels all match it does not repeat itself 4 times, but it does tell you which labels it found. Or you could just post the results here (…

[image] etorix: And full output of zdb -l for all six drives in the pool please, not just the supposedly problematic ones. Two failing drives should not suffice to suspend a raidz2. root@freenas[~]# zdb -l /dev/sda1 ------------------------------------ LABEL 0 --------------------------------…

Bringing back a SUSPENDED pool that doesn't show up with `zpool status`

TrueNAS General

winnielinnie June 4, 2025, 3:08pm 21

I love this game.

Topic		Replies	Views
Unreadable and uncorrectable sectors on two drives TrueNAS General SCALE , Issue , Hardware	16	1133	October 26, 2024
Cant import pool I/O error. Am I goosed? TrueNAS General SCALE , ZFS	7	191	March 6, 2025
Can't import a pool, but no errors TrueNAS General SCALE , Hardware , ZFS , Import-problem	12	251	November 27, 2025
SMART 'failed to read smart attribute data' alert on scale TrueNAS General	21	1164	February 14, 2025
S.M.A.R.T concerns for "new" disks TrueNAS General SCALE , SMART	1	99	August 27, 2024

Bringing back a SUSPENDED pool that doesn't show up with `zpool status`

Related topics