Pool exported after reboot - cannot import said pool (I/O error) - no SMART errors

TrueNAS General
, , ,
1

Hello,
I am running TrueNAS Community Edition 25.04.2.4.

Here is my hardware:

Mainboard: ASUS Z97-K
CPU: Intel Core i7-4770K
RAM: 3x various 8GB DDR3 modules
NIC: TP-Link TG-3468

Drives:
1x 128GB Intenso SSD (boot/OS drive)

Apps pool
1x 480GB SanDisk SSD

Storage pool (the one that cannot be imported)
2x 4TB Seagate Iron Wolf (mirrored)

I had a similar issue in the past, but rebooting usually fixed it. I’ve swapped out the PSU in the mean time because the old one no longer worked.
After that, the HDDs were (again) no longer assigned to the ‘storage’ pool and were instead listed as exported. Trying the usual fix (rebooting) did not work this time.
Reading other posts in the forum helped me understand a little more, but I haven’t managed to fix it, which is why I’m here.

I tried importing the pool through the shell, which failed:

# zpool import storage
[  137.030052] WARNING: can't open objset 92, error 5
[  137.143076] WARNING: can't open objset 92, error 5
[  137.246821] WARNING: can't open objset 92, error 5
[  137.340995] WARNING: can't open objset 92, error 5
cannot import 'storage': I/O error
Destroy and re-create the pool from a backup source.

(not sure what the objset thing is, it only shows up when you run the command from the machine itself, not using the web interface)
I tried forcing the import (through the shell), same result.
I rebooted a few times, hoping it would fix itself again, no luck.
I checked if the mount point (in /mnt) exists and it does (/mnt/storage).
There is somewhat important data on there, but it would be very inconvenient to set up the apps again.

If there is no way to import the pool into TrueNAS, is there a way to at least pull the data from the drives?

Any help would be appreciated! If additional information is required, please let me know.

2

Can you run a short SMART selftest on both drives? If a drive fails a short selftest, then there’s no need to run a long test.

This could be a hardware or drive failure.

3

Did that, no errors (I would post some screenshots, but I do not have permission). I already ran some manual tests a while ago. They also run on a schedule; there were never any errors.

4

Had a very similar system for familly a few years back that had its sata ports randomly failing over time… until the chipset died & nothing worked.

1 Like
5

Can you post these inside of preformatted text? Replace X with your drive letters. Do it for both drives.

smartctl -l error /dev/sdX

smartctl -l selftest /dev/sdX

smartctl -a /dev/sdX

These might help too:

zpool import

lsblk -o NAME,MODEL,PTTYPE,TYPE,SIZE,PARTTYPENAME,PARTUUID
6

Good to know. I’ll keep that in mind.

7

To be fair, it put in solid work since… 2013? So it did a solid >10 years

8

Here’s the output of all commands for each drive (I replaced the serial numbers with #-symbols):

/dev/sda

root@truenas[/home/truenas_admin]# smartctl -l error /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[/home/truenas_admin]# smartctl -l selftest /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      3478         -
# 2  Extended offline    Completed without error       00%      3477         -
# 3  Short offline       Completed without error       00%      3387         -
# 4  Extended offline    Completed without error       00%      3327         -
# 5  Short offline       Completed without error       00%      3284         -
# 6  Short offline       Completed without error       00%      3051         -
# 7  Short offline       Completed without error       00%      2883         -
# 8  Short offline       Completed without error       00%      2715         -
# 9  Extended offline    Completed without error       00%      2584         -
#10  Short offline       Completed without error       00%      2547         -
#11  Short offline       Completed without error       00%      2379         -
#12  Short offline       Completed without error       00%      2211         -
#13  Short offline       Completed without error       00%      2043         -
#14  Short offline       Completed without error       00%      1875         -
#15  Extended offline    Completed without error       00%      1864         -
#16  Short offline       Completed without error       00%      1706         -
#17  Short offline       Completed without error       00%      1538         -
#18  Short offline       Completed without error       00%      1370         -
#19  Short offline       Completed without error       00%      1202         -
#20  Extended offline    Completed without error       00%      1119         -
#21  Short offline       Completed without error       00%      1034         -

root@truenas[/home/truenas_admin]# smartctl -a /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate IronWolf
Device Model:     ST4000VN006-3CW104
Serial Number:    ########
LU WWN Device Id: 5 000c50 0fb1e2a97
Firmware Version: SC60
User Capacity:    4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6028
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu Apr  9 20:51:23 2026 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x73) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        No Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 477) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x70bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   081   064   006    Pre-fail  Always       -       0/124550988
  3 Spin_Up_Time            0x0003   096   095   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       84
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   073   060   045    Pre-fail  Always       -       0/20743439
  9 Power_On_Hours          0x0032   097   097   000    Old_age   Always       -       3479
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       84
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   074   059   040    Old_age   Always       -       26 (Min/Max 21/26)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       131
193 Load_Cycle_Count        0x0032   099   099   000    Old_age   Always       -       2357
194 Temperature_Celsius     0x0022   026   041   000    Old_age   Always       -       26 (0 17 0 0 0)
195 Hardware_ECC_Recovered  0x001a   081   064   000    Old_age   Always       -       0/124550988
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       3188h+15m+56.309s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1350033192
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3901300774

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      3478         -
# 2  Extended offline    Completed without error       00%      3477         -
# 3  Short offline       Completed without error       00%      3387         -
# 4  Extended offline    Completed without error       00%      3327         -
# 5  Short offline       Completed without error       00%      3284         -
# 6  Short offline       Completed without error       00%      3051         -
# 7  Short offline       Completed without error       00%      2883         -
# 8  Short offline       Completed without error       00%      2715         -
# 9  Extended offline    Completed without error       00%      2584         -
#10  Short offline       Completed without error       00%      2547         -
#11  Short offline       Completed without error       00%      2379         -
#12  Short offline       Completed without error       00%      2211         -
#13  Short offline       Completed without error       00%      2043         -
#14  Short offline       Completed without error       00%      1875         -
#15  Extended offline    Completed without error       00%      1864         -
#16  Short offline       Completed without error       00%      1706         -
#17  Short offline       Completed without error       00%      1538         -
#18  Short offline       Completed without error       00%      1370         -
#19  Short offline       Completed without error       00%      1202         -
#20  Extended offline    Completed without error       00%      1119         -
#21  Short offline       Completed without error       00%      1034         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

The above only provides legacy SMART information - try 'smartctl -x' for more

/dev/sdc

root@truenas[/home/truenas_admin]# smartctl -l error /dev/sdc   
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[/home/truenas_admin]# smartctl -l selftest /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      3479         -
# 2  Extended offline    Completed without error       00%      3477         -
# 3  Short offline       Completed without error       00%      3387         -
# 4  Extended offline    Completed without error       00%      3327         -
# 5  Short offline       Completed without error       00%      3284         -
# 6  Short offline       Completed without error       00%      3051         -
# 7  Short offline       Completed without error       00%      2883         -
# 8  Short offline       Completed without error       00%      2715         -
# 9  Extended offline    Completed without error       00%      2584         -
#10  Short offline       Completed without error       00%      2547         -
#11  Short offline       Completed without error       00%      2379         -
#12  Short offline       Completed without error       00%      2211         -
#13  Short offline       Completed without error       00%      2043         -
#14  Short offline       Completed without error       00%      1875         -
#15  Extended offline    Completed without error       00%      1864         -
#16  Short offline       Completed without error       00%      1706         -
#17  Short offline       Completed without error       00%      1538         -
#18  Short offline       Completed without error       00%      1370         -
#19  Short offline       Completed without error       00%      1202         -
#20  Extended offline    Completed without error       00%      1119         -
#21  Short offline       Completed without error       00%      1034         -

root@truenas[/home/truenas_admin]# smartctl -a /dev/sdc         
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate IronWolf
Device Model:     ST4000VN006-3CW104
Serial Number:    ########
LU WWN Device Id: 5 000c50 0fb1f2406
Firmware Version: SC60
User Capacity:    4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6028
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu Apr  9 20:54:04 2026 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x73) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        No Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 467) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x70bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   081   064   006    Pre-fail  Always       -       0/124482764
  3 Spin_Up_Time            0x0003   096   095   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       43
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   073   060   045    Pre-fail  Always       -       0/20259430
  9 Power_On_Hours          0x0032   097   097   000    Old_age   Always       -       3479
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       43
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   073   060   040    Old_age   Always       -       27 (Min/Max 21/27)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       88
193 Load_Cycle_Count        0x0032   099   099   000    Old_age   Always       -       2319
194 Temperature_Celsius     0x0022   027   040   000    Old_age   Always       -       27 (0 17 0 0 0)
195 Hardware_ECC_Recovered  0x001a   081   064   000    Old_age   Always       -       0/124482764
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       3190h+40m+01.581s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1350053112
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3897453621

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      3479         -
# 2  Extended offline    Completed without error       00%      3477         -
# 3  Short offline       Completed without error       00%      3387         -
# 4  Extended offline    Completed without error       00%      3327         -
# 5  Short offline       Completed without error       00%      3284         -
# 6  Short offline       Completed without error       00%      3051         -
# 7  Short offline       Completed without error       00%      2883         -
# 8  Short offline       Completed without error       00%      2715         -
# 9  Extended offline    Completed without error       00%      2584         -
#10  Short offline       Completed without error       00%      2547         -
#11  Short offline       Completed without error       00%      2379         -
#12  Short offline       Completed without error       00%      2211         -
#13  Short offline       Completed without error       00%      2043         -
#14  Short offline       Completed without error       00%      1875         -
#15  Extended offline    Completed without error       00%      1864         -
#16  Short offline       Completed without error       00%      1706         -
#17  Short offline       Completed without error       00%      1538         -
#18  Short offline       Completed without error       00%      1370         -
#19  Short offline       Completed without error       00%      1202         -
#20  Extended offline    Completed without error       00%      1119         -
#21  Short offline       Completed without error       00%      1034         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

The above only provides legacy SMART information - try 'smartctl -x' for more

zpool import

root@truenas[/home/truenas_admin]# zpool import 
  pool: storage
    id: 12951324627754258797
 state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:

        storage                                   ONLINE
          mirror-0                                ONLINE
            60b285cd-1478-4399-bb90-e4a44446cd57  ONLINE
            e5600284-870e-4e80-bc22-ce4dae24bf51  ONLINE

lsblk

root@truenas[/home/truenas_admin]# lsblk -o NAME,MODEL,PTTYPE,TYPE,SIZE,PARTTYPENAME,PARTUUID
NAME   MODEL                  PTTYPE TYPE   SIZE PARTTYPENAME             PARTUUID
sda    ST4000VN006-3CW104     gpt    disk   3.6T                          
└─sda1                        gpt    part   3.6T Solaris /usr & Apple ZFS 60b285cd-1478-4399-bb90-e4a44446cd57
sdb    SanDisk SSD PLUS 480GB gpt    disk 447.1G                          
└─sdb1                        gpt    part 445.1G Solaris /usr & Apple ZFS 0653491b-00e1-4758-8dd6-a2fbf5bb2f45
sdc    ST4000VN006-3CW104     gpt    disk   3.6T                          
└─sdc1                        gpt    part   3.6T Solaris /usr & Apple ZFS e5600284-870e-4e80-bc22-ce4dae24bf51
sdd    Intenso SSD Sata III   gpt    disk 119.2G                          
├─sdd1                        gpt    part     1M BIOS boot                449a9548-b1cc-4ad3-98ea-de86b7a36392
├─sdd2                        gpt    part   512M EFI System               442f378a-225f-458d-9645-ef68e9e5c33b
└─sdd3                        gpt    part 118.7G Solaris /usr & Apple ZFS cd31d8dc-bac1-4ec0-abff-7faad1c09454

Trying to import the pool using the shell

root@truenas[/home/truenas_admin]# zpool import storage
cannot import 'storage': I/O error
        Destroy and re-create the pool from
        a backup source.

This shows up in the logs while executing the command above:

Apr  9 20:59:25 truenas kernel: WARNING: can't open objset 92, error 5
Apr  9 20:59:25 truenas kernel: WARNING: can't open objset 92, error 5
Apr  9 20:59:26 truenas kernel: WARNING: can't open objset 92, error 5
Apr  9 20:59:26 truenas kernel: WARNING: can't open objset 92, error 5
9

Nothing obviously appears to be failing with the drives.

How are they connected?

Did you use any additional vdevs in the pool before? SLOG? L2ARC? Special Vdev?

What is the output of the following? Preformatted text and keep them as separate boxes so it’s easier to read and compare.

zdb -l /dev/disk/by-partuuid/60b285cd-1478-4399-bb90-e4a44446cd57

zdb -l /dev/disk/by-partuuid/e5600284-870e-4e80-bc22-ce4dae24bf51
10

Anything else of interest in dmesg? I’m also wondering, if you have a spare system that you can turn into a quick test (even a usb truenas boot drive & just those two disks connected) so we can rule out my theory of aging hardware…

11

The drives are connected via SATA cables to the SATA ports on the motherboard.

I don’t think I used anything like SLOG, L2ARC or a special VDEV. I basically just heard about them now, looked them up and I’m pretty sure I am not using them (or used them before). When I set up the pool, I put the drives in the system and went through the pool setup without doing anything special (1 mirror vdev, 2 drives).

Here’s the output of the commands:

First command (disk 60b285cd-…)

truenas_admin@truenas[~]$ zdb -l /dev/disk/by-partuuid/60b285cd-1478-4399-bb90-e4a44446cd57
zsh: command not found: zdb
truenas_admin@truenas[~]$ sudo !!
sudo zdb -l /dev/disk/by-partuuid/60b285cd-1478-4399-bb90-e4a44446cd57
[sudo] password for truenas_admin: 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'storage'
    state: 0
    txg: 2286314
    pool_guid: 12951324627754258797
    errata: 0
    hostid: 288249714
    hostname: 'truenas'
    top_guid: 6096825609243483613
    guid: 1042875828601283943
    vdev_children: 1
    vdev_tree:
        type: 'mirror'
        id: 0
        guid: 6096825609243483613
        metaslab_array: 128
        metaslab_shift: 34
        ashift: 12
        asize: 3998633951232
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 1042875828601283943
            path: '/dev/disk/by-partuuid/60b285cd-1478-4399-bb90-e4a44446cd57'
            whole_disk: 0
            DTL: 22976
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 4149827992360593829
            path: '/dev/disk/by-partuuid/e5600284-870e-4e80-bc22-ce4dae24bf51'
            whole_disk: 0
            DTL: 22975
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3

Second command (disk e5600284-…)

truenas_admin@truenas[~]$ sudo zdb -l /dev/disk/by-partuuid/e5600284-870e-4e80-bc22-ce4dae24bf51
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'storage'
    state: 0
    txg: 2286314
    pool_guid: 12951324627754258797
    errata: 0
    hostid: 288249714
    hostname: 'truenas'
    top_guid: 6096825609243483613
    guid: 4149827992360593829
    vdev_children: 1
    vdev_tree:
        type: 'mirror'
        id: 0
        guid: 6096825609243483613
        metaslab_array: 128
        metaslab_shift: 34
        ashift: 12
        asize: 3998633951232
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 1042875828601283943
            path: '/dev/disk/by-partuuid/60b285cd-1478-4399-bb90-e4a44446cd57'
            whole_disk: 0
            DTL: 22976
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 4149827992360593829
            path: '/dev/disk/by-partuuid/e5600284-870e-4e80-bc22-ce4dae24bf51'
            whole_disk: 0
            DTL: 22975
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3
12

Nothing really sticks out when looking at dmesg. There are some ACPI errors when booting, but they have always been there.

[    1.601320] ACPI BIOS Error (bug): Could not resolve symbol [\_SB.PCI0.SAT0.SPT5._GTF.DSSP], AE_NOT_FOUND (20240827/psargs-332)
[    1.616063] ACPI Error: Aborting method \_SB.PCI0.SAT0.SPT5._GTF due to previous error (AE_NOT_FOUND) (20240827/psparse-529)

This also shows up when booting, not sure if it is new or not, since it’s been there the last few times I booted the system.

[    6.346275] Error: Driver 'pcspkr' is already registered, aborting...

The “can’t open objset” error I get when trying to import the pool also shows up on boot, probably because the system tries to import the pool but fails. Nothing else related to that shows up in dmesg after this point, no errors or warnings after this, only network stuff as far as I can tell.

[   36.682739] WARNING: can't open objset 92, error 5
[   36.852627] WARNING: can't open objset 92, error 5
[   37.104947] WARNING: can't open objset 92, error 5
[   37.272086] WARNING: can't open objset 92, error 5

I have a system here I could use to test (besides my main PC). Don’t know if their SATA ports are good and they are also pretty old and used, but I might try that.

13

I’m seeing nothing obviously wrong.

No SMART errors or failed selftests.
No missing devices.
Drives and partitions detected by the system.
No discrepancies with zdb on the two ZFS members of the mirror vdev.

I’m out of ideas. If you’re able to import the pool in another system, it might give us another hint.

@HoneyBadger are we missing anything obvious?