Can’t access my pool because all disks have been exported?

truenasrooks · November 19, 2024, 1:51pm

Im having same issue. all 3 disks in my mirror pool went offline and disks were exported and i was not able to import back using
zpool import tank (my pool name)

so i went and disconnected / exported the empty pool

so i tried to import back from UI. As well as from shell. Error is same

middlewared.service_exception.CallError: [EZFS_BADDEV] Failed to import ‘tank’ pool: cannot import ‘tank’ as ‘tank’: one or more devices is currently unavailable

root@truenas[/home/admin]# zpool import
pool: tank
id: 5087050144587203797
state: ONLINE
status: One or more devices were being resilvered.
action: The pool can be imported using its name or numeric identifier.
config:

    tank                                      ONLINE
      mirror-0                                ONLINE
        a9e51b2f-2df8-48ae-9c3e-6303e9256c28  ONLINE
        d08bcfdf-d4fc-4094-8978-7f29368f737f  ONLINE
        a3573b00-d380-4587-806a-8a1a50690002  ONLINE

root@truenas[/home/admin]# zpool import tank
cannot import ‘tank’: one or more devices is currently unavailable
root@truenas[/home/admin]#

root@truenas[/home/admin]# zpool import
  pool: tank
    id: 5087050144587203797
 state: ONLINE
status: One or more devices were being resilvered.
action: The pool can be imported using its name or numeric identifier.
config:

        tank                                      ONLINE
          mirror-0                                ONLINE
            a9e51b2f-2df8-48ae-9c3e-6303e9256c28  ONLINE
            d08bcfdf-d4fc-4094-8978-7f29368f737f  ONLINE
            a3573b00-d380-4587-806a-8a1a50690002  ONLINE
root@truenas[/home/admin]# zpool status -v
  pool: boot-pool
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 00:01:55 with 0 errors on Fri Nov 15 03:46:56 2024
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          sda3      ONLINE       0     0     0

errors: No known data errors

  pool: ssd
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 00:09:35 with 0 errors on Sun Oct 13 00:09:37 2024
config:

        NAME                                      STATE     READ WRITE CKSUM
        ssd                                       ONLINE       0     0     0
          mirror-0                                ONLINE       0     0     0
            334cbbbb-e0d5-40c6-8462-5f82b0033ad7  ONLINE       0     0     0
            d4c7f156-eff2-410c-b410-46c884c268f8  ONLINE       0     0     0

errors: No known data errors

root@truenas[/home/admin]# smartctl -x /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     HUH721212ALE601
Serial Number:    AAH0NPLH
LU WWN Device Id: 5 000cca 278ce6532
Firmware Version: LEGL0002
User Capacity:    12,000,138,625,024 bytes [12.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        Not in smartctl database 7.3/5528
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Nov 19 08:43:44 2024 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 244) Self-test routine in progress...
                                        40% of test remaining.
Total time to complete Offline 
data collection:                (   87) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   132   132   054    -    96
  3 Spin_Up_Time            POS---   253   253   024    -    165 (Average 138)
  4 Start_Stop_Count        -O--C-   100   100   000    -    1412
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    33047
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    1355
 22 Unknown_Attribute       PO---K   100   100   025    -    100
 45 Unknown_Attribute       PO---K   100   100   001    -    1095233372415
192 Power-Off_Retract_Count -O--CK   099   099   000    -    1979
193 Load_Cycle_Count        -O--C-   099   099   000    -    1979
194 Temperature_Celsius     -O----   153   153   000    -    39 (Min/Max 17/52)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
231 Temperature_Celsius     -O--CK   100   100   000    -    0
241 Total_LBAs_Written      -O--C-   100   100   000    -    3004770660951
242 Total_LBAs_Read         -O--C-   100   100   000    -    4021385718986
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O   5501  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80       GPL     R/W    688  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS     688  Device vendor specific log
0xc8       GPL     VS      12  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     33037         -
# 2  Short offline       Completed without error       00%     32838         -
# 3  Short offline       Completed without error       00%     32252         -
# 4  Short offline       Completed without error       00%     31532         -
# 5  Short offline       Completed without error       00%     31148         -
# 6  Short offline       Completed without error       00%     30789         -
# 7  Short offline       Completed without error       00%     30047         -
# 8  Short offline       Completed without error       00%     29529         -
# 9  Short offline       Completed without error       00%     29139         -
#10  Short offline       Completed without error       00%     29115         -
#11  Vendor (0x70)       Completed without error       00%     29056         -
#12  Vendor (0x71)       Completed without error       00%     29056         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        DST executing in background (3)
Current Temperature:                    39 Celsius
Power Cycle Min/Max Temperature:     33/39 Celsius
Lifetime    Min/Max Temperature:     17/52 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (9)

Index    Estimated Time   Temperature Celsius
  10    2024-11-19 06:36    39  ********************
 ...    ..(126 skipped).    ..  ********************
   9    2024-11-19 08:43    39  ********************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4            1355  ---  Lifetime Power-On Resets
0x01  0x010  4           33047  ---  Power-on Hours
0x01  0x018  6   3004770660951  ---  Logical Sectors Written
0x01  0x020  6      4417887977  ---  Number of Write Commands
0x01  0x028  6   4021385718986  ---  Logical Sectors Read
0x01  0x030  6      5894840581  ---  Number of Read Commands
0x01  0x038  6    118971849250  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           32913  ---  Spindle Motor Power-on Hours
0x03  0x010  4           32913  ---  Head Flying Hours
0x03  0x018  4            1979  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4            1414  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              39  ---  Current Temperature
0x05  0x010  1              38  N--  Average Short Term Temperature
0x05  0x018  1              30  N--  Average Long Term Temperature
0x05  0x020  1              52  ---  Highest Temperature
0x05  0x028  1              17  ---  Lowest Temperature
0x05  0x030  1              51  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              50  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4            1327  ---  Number of Hardware Resets
0x06  0x010  4             166  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            3  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

root@truenas[/home/admin]# smartctl -x /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     HUH721212ALE601
Serial Number:    8CG9NRAE
LU WWN Device Id: 5 000cca 26fc4651f
Firmware Version: LEGL0002
User Capacity:    12,000,138,625,024 bytes [12.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        Not in smartctl database 7.3/5528
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Nov 19 08:43:55 2024 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 244) Self-test routine in progress...
                                        40% of test remaining.
Total time to complete Offline 
data collection:                (   87) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   132   132   054    -    96
  3 Spin_Up_Time            POS---   253   253   024    -    167 (Average 307)
  4 Start_Stop_Count        -O--C-   100   100   000    -    1122
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    31162
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    1036
 22 Unknown_Attribute       PO---K   100   100   025    -    100
 45 Unknown_Attribute       PO---K   100   100   001    -    1095233372415
192 Power-Off_Retract_Count -O--CK   099   099   000    -    1658
193 Load_Cycle_Count        -O--C-   099   099   000    -    1658
194 Temperature_Celsius     -O----   150   150   000    -    40 (Min/Max 17/57)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
231 Temperature_Celsius     -O--CK   100   100   000    -    0
241 Total_LBAs_Written      -O--C-   100   100   000    -    2733263818348
242 Total_LBAs_Read         -O--C-   100   100   000    -    2917048905454
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O   5501  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80       GPL     R/W    688  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS     688  Device vendor specific log
0xc8       GPL     VS      12  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     31152         -
# 2  Short offline       Completed without error       00%     31150         -
# 3  Short offline       Completed without error       00%     30948         -
# 4  Short offline       Completed without error       00%     30362         -
# 5  Short offline       Completed without error       00%     29642         -
# 6  Short offline       Completed without error       00%     29258         -
# 7  Short offline       Completed without error       00%     28898         -
# 8  Short offline       Completed without error       00%     28156         -
# 9  Short offline       Completed without error       00%     27638         -
#10  Short offline       Completed without error       00%     26894         -
#11  Short offline       Completed without error       00%     26200         -
#12  Short offline       Completed without error       00%     26149         -
#13  Extended offline    Completed without error       00%     25771         -
#14  Vendor (0x70)       Completed without error       00%     25542         -
#15  Vendor (0x71)       Completed without error       00%     25542         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        DST executing in background (3)
Current Temperature:                    40 Celsius
Power Cycle Min/Max Temperature:     35/40 Celsius
Lifetime    Min/Max Temperature:     17/57 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (106)

Index    Estimated Time   Temperature Celsius
 107    2024-11-19 06:36    40  *********************
 ...    ..(126 skipped).    ..  *********************
 106    2024-11-19 08:43    40  *********************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4            1036  ---  Lifetime Power-On Resets
0x01  0x010  4           31162  ---  Power-on Hours
0x01  0x018  6   2733263818348  ---  Logical Sectors Written
0x01  0x020  6      3580660670  ---  Number of Write Commands
0x01  0x028  6   2917048905454  ---  Logical Sectors Read
0x01  0x030  6      4327139935  ---  Number of Read Commands
0x01  0x038  6    112186236900  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           30985  ---  Spindle Motor Power-on Hours
0x03  0x010  4           30985  ---  Head Flying Hours
0x03  0x018  4            1658  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4              50  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              40  ---  Current Temperature
0x05  0x010  1              39  N--  Average Short Term Temperature
0x05  0x018  1              31  N--  Average Long Term Temperature
0x05  0x020  1              57  ---  Highest Temperature
0x05  0x028  1              17  ---  Lowest Temperature
0x05  0x030  1              54  N--  Highest Average Short Term Temperature
0x05  0x038  1              23  N--  Lowest Average Short Term Temperature
0x05  0x040  1              52  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4            1349  ---  Number of Hardware Resets
0x06  0x010  4             250  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

root@truenas[/home/admin]# smartctl -x /dev/sdf
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     HUH721212ALE601
Serial Number:    8CJVUUNE
LU WWN Device Id: 5 000cca 26fe8619c
Firmware Version: LEGL0002
User Capacity:    12,000,138,625,024 bytes [12.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        Not in smartctl database 7.3/5528
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Nov 19 08:43:57 2024 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, NOT FROZEN [SEC1], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 244) Self-test routine in progress...
                                        40% of test remaining.
Total time to complete Offline 
data collection:                (   87) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   132   132   054    -    96
  3 Spin_Up_Time            POS---   253   253   024    -    258 (Average 181)
  4 Start_Stop_Count        -O--C-   100   100   000    -    789
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   097   097   000    -    21378
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    677
 22 Unknown_Attribute       PO---K   100   100   025    -    100
 45 Unknown_Attribute       PO---K   100   100   001    -    1095233372415
192 Power-Off_Retract_Count -O--CK   099   099   000    -    1350
193 Load_Cycle_Count        -O--C-   099   099   000    -    1350
194 Temperature_Celsius     -O----   214   214   000    -    28 (Min/Max 17/53)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
231 Temperature_Celsius     -O--CK   100   100   000    -    0
241 Total_LBAs_Written      -O--C-   100   100   000    -    1438251717432
242 Total_LBAs_Read         -O--C-   100   100   000    -    2093635904935
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O   5501  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80       GPL     R/W    688  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS     688  Device vendor specific log
0xc8       GPL     VS      12  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     21367         -
# 2  Short offline       Completed without error       00%     21162         -
# 3  Short offline       Completed without error       00%     20577         -
# 4  Short offline       Completed without error       00%     19857         -
# 5  Short offline       Completed without error       00%     19472         -
# 6  Short offline       Completed without error       00%     19113         -
# 7  Short offline       Completed without error       00%     18371         -
# 8  Short offline       Completed without error       00%     17853         -
# 9  Short offline       Completed without error       00%     17109         -
#10  Short offline       Completed without error       00%     16415         -
#11  Short offline       Completed without error       00%     16364         -
#12  Extended offline    Completed without error       00%     15987         -
#13  Short offline       Completed without error       00%     15966         -
#14  Vendor (0x70)       Completed without error       00%     15853         -
#15  Vendor (0x71)       Completed without error       00%     15853         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        DST executing in background (3)
Current Temperature:                    28 Celsius
Power Cycle Min/Max Temperature:     21/29 Celsius
Lifetime    Min/Max Temperature:     17/53 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (1)

Index    Estimated Time   Temperature Celsius
   2    2024-11-19 06:36    28  *********
 ...    ..(126 skipped).    ..  *********
   1    2024-11-19 08:43    28  *********

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4             677  ---  Lifetime Power-On Resets
0x01  0x010  4           21378  ---  Power-on Hours
0x01  0x018  6   1438251717432  ---  Logical Sectors Written
0x01  0x020  6      1635487791  ---  Number of Write Commands
0x01  0x028  6   2093635904935  ---  Logical Sectors Read
0x01  0x030  6      2702814852  ---  Number of Read Commands
0x01  0x038  6     76961065150  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           21215  ---  Spindle Motor Power-on Hours
0x03  0x010  4           21215  ---  Head Flying Hours
0x03  0x018  4            1350  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               3  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              28  ---  Current Temperature
0x05  0x010  1              28  N--  Average Short Term Temperature
0x05  0x018  1              33  N--  Average Long Term Temperature
0x05  0x020  1              53  ---  Highest Temperature
0x05  0x028  1              17  ---  Lowest Temperature
0x05  0x030  1              52  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              47  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4            1004  ---  Number of Hardware Resets
0x06  0x010  4             268  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            1  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

root@truenas[/home/admin]# root@truenas[/home/admin]# zpool import
pool: tank
id: 5087050144587203797
state: ONLINE
status: One or more devices were being resilvered.
action: The pool can be imported using its name or numeric identifier.
config:

    tank                                      ONLINE
      mirror-0                                ONLINE
        a9e51b2f-2df8-48ae-9c3e-6303e9256c28  ONLINE
        d08bcfdf-d4fc-4094-8978-7f29368f737f  ONLINE
        a3573b00-d380-4587-806a-8a1a50690002  ONLINE
root@truenas[/home/admin]# zpool import tank
cannot import ‘tank’: one or more devices is currently unavailable
root@truenas[/home/admin]#

bacon · November 19, 2024, 2:02pm

That doesn’t look good. Maybe check dmesg for any ZFS related error messages?

truenasrooks · November 19, 2024, 2:34pm

im doing long test on all 3 disks. Short test was fine. Also i recently upgraded truenas scale to new version Electric Eel.

what might be the issue ? i will execute the above command and report back

bacon · November 19, 2024, 2:40pm

Hm… can you post system specs? I this a virtualized system?

truenasrooks · November 19, 2024, 2:54pm

No bare metal.

Running in ryzen 3700x b450 board 32g ram. 3070 gpu for transcoding and 2.5g nic

Boot pool, ssd pool and hdd all are connected to motherboard only. No hba card.

bacon · November 19, 2024, 3:10pm

Difficult to tell what’s going on without proper error messages.

Were there any recent hardware or configuration changes?

Maybe add the event log in addition to the dmesg output:

sudo zpool events -v tank
sudo dmesg

truenasrooks · November 19, 2024, 3:48pm


[    0.616606] pci 0000:03:00.1: reg 0x24: [mem 0xfc780000-0xfc79ffff]
[    0.616615] pci 0000:03:00.1: reg 0x30: [mem 0xfc700000-0xfc77ffff pref]
[    0.616667] pci 0000:03:00.1: PME# supported from D3hot D3cold
[    0.616775] pci 0000:03:00.2: [1022:43c6] type 01 class 0x060400
[    0.616875] pci 0000:03:00.2: PME# supported from D3hot D3cold
[    0.617014] pci 0000:00:01.3: PCI bridge to [bus 03-25]
[    0.617018] pci 0000:00:01.3:   bridge window [io  0xd000-0xefff]
[    0.617021] pci 0000:00:01.3:   bridge window [mem 0xfc500000-0xfc7fffff]
[    0.617139] pci 0000:20:00.0: [1022:43c7] type 01 class 0x060400
[    0.617260] pci 0000:20:00.0: PME# supported from D3hot D3cold
[    0.617402] pci 0000:20:01.0: [1022:43c7] type 01 class 0x060400
[    0.617521] pci 0000:20:01.0: PME# supported from D3hot D3cold
[    0.617676] pci 0000:20:04.0: [1022:43c7] type 01 class 0x060400
[    0.617729] pci 0000:20:04.0: enabling Extended Tags
[    0.617800] pci 0000:20:04.0: PME# supported from D3hot D3cold
[    0.617957] pci 0000:03:00.2: PCI bridge to [bus 20-25]
[    0.617963] pci 0000:03:00.2:   bridge window [io  0xd000-0xefff]
[    0.617966] pci 0000:03:00.2:   bridge window [mem 0xfc500000-0xfc6fffff]
[    0.618046] pci 0000:21:00.0: [10ec:8125] type 00 class 0x020000
[    0.618072] pci 0000:21:00.0: reg 0x10: [io  0xe000-0xe0ff]
[    0.618107] pci 0000:21:00.0: reg 0x18: [mem 0xfc610000-0xfc61ffff 64bit]
[    0.618130] pci 0000:21:00.0: reg 0x20: [mem 0xfc620000-0xfc623fff 64bit]
[    0.618145] pci 0000:21:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[    0.618290] pci 0000:21:00.0: supports D1 D2
[    0.618291] pci 0000:21:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.618607] pci 0000:20:00.0: PCI bridge to [bus 21]
[    0.618614] pci 0000:20:00.0:   bridge window [io  0xe000-0xefff]
[    0.618617] pci 0000:20:00.0:   bridge window [mem 0xfc600000-0xfc6fffff]
[    0.618702] pci 0000:22:00.0: [10ec:8168] type 00 class 0x020000
[    0.618731] pci 0000:22:00.0: reg 0x10: [io  0xd000-0xd0ff]
[    0.618772] pci 0000:22:00.0: reg 0x18: [mem 0xfc504000-0xfc504fff 64bit]
[    0.618797] pci 0000:22:00.0: reg 0x20: [mem 0xfc500000-0xfc503fff 64bit]
[    0.618959] pci 0000:22:00.0: supports D1 D2
[    0.618960] pci 0000:22:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.619251] pci 0000:20:01.0: PCI bridge to [bus 22]
[    0.619257] pci 0000:20:01.0:   bridge window [io  0xd000-0xdfff]
[    0.619261] pci 0000:20:01.0:   bridge window [mem 0xfc500000-0xfc5fffff]
[    0.619315] pci 0000:20:04.0: PCI bridge to [bus 25]
[    0.619397] pci 0000:26:00.0: [10de:2484] type 00 class 0x030000
[    0.619409] pci 0000:26:00.0: reg 0x10: [mem 0xfb000000-0xfbffffff]
[    0.619419] pci 0000:26:00.0: reg 0x14: [mem 0xd0000000-0xdfffffff 64bit pref]
[    0.619430] pci 0000:26:00.0: reg 0x1c: [mem 0xe0000000-0xe1ffffff 64bit pref]
[    0.619437] pci 0000:26:00.0: reg 0x24: [io  0xf000-0xf07f]
[    0.619444] pci 0000:26:00.0: reg 0x30: [mem 0xfc000000-0xfc07ffff pref]
[    0.619461] pci 0000:26:00.0: BAR 1: assigned to efifb
[    0.619466] pci 0000:26:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.619513] pci 0000:26:00.0: PME# supported from D0 D3hot
[    0.619595] pci 0000:26:00.0: 126.016 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x16 link at 0000:00:03.1 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)
[    0.619696] pci 0000:26:00.1: [10de:228b] type 00 class 0x040300
[    0.619708] pci 0000:26:00.1: reg 0x10: [mem 0xfc080000-0xfc083fff]
[    0.619870] pci 0000:00:03.1: PCI bridge to [bus 26]
[    0.619874] pci 0000:00:03.1:   bridge window [io  0xf000-0xffff]
[    0.619877] pci 0000:00:03.1:   bridge window [mem 0xfb000000-0xfc0fffff]
[    0.619881] pci 0000:00:03.1:   bridge window [mem 0xd0000000-0xe1ffffff 64bit pref]
[    0.619928] pci 0000:27:00.0: [1022:148a] type 00 class 0x130000
[    0.620117] pci 0000:00:07.1: PCI bridge to [bus 27]
[    0.620183] pci 0000:28:00.0: [1022:1485] type 00 class 0x130000
[    0.620379] pci 0000:28:00.1: [1022:1486] type 00 class 0x108000
[    0.620396] pci 0000:28:00.1: reg 0x18: [mem 0xfc300000-0xfc3fffff]
[    0.620409] pci 0000:28:00.1: reg 0x24: [mem 0xfc408000-0xfc409fff]
[    0.620553] pci 0000:28:00.3: [1022:149c] type 00 class 0x0c0330
[    0.620567] pci 0000:28:00.3: reg 0x10: [mem 0xfc200000-0xfc2fffff 64bit]
[    0.620643] pci 0000:28:00.3: PME# supported from D0 D3hot D3cold
[    0.620761] pci 0000:28:00.4: [1022:1487] type 00 class 0x040300
[    0.620770] pci 0000:28:00.4: reg 0x10: [mem 0xfc400000-0xfc407fff]
[    0.620840] pci 0000:28:00.4: PME# supported from D0 D3hot D3cold
[    0.620969] pci 0000:00:08.1: PCI bridge to [bus 28]
[    0.620974] pci 0000:00:08.1:   bridge window [mem 0xfc200000-0xfc4fffff]
[    0.621026] pci 0000:31:00.0: [1022:7901] type 00 class 0x010601
[    0.621062] pci 0000:31:00.0: reg 0x24: [mem 0xfc800000-0xfc8007ff]
[    0.621129] pci 0000:31:00.0: PME# supported from D3hot D3cold
[    0.621282] pci 0000:00:08.3: PCI bridge to [bus 31]
[    0.621286] pci 0000:00:08.3:   bridge window [mem 0xfc800000-0xfc8fffff]
[    0.621860] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[    0.621909] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[    0.621952] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[    0.622004] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[    0.622052] ACPI: PCI: Interrupt link LNKE configured for IRQ 0
[    0.622091] ACPI: PCI: Interrupt link LNKF configured for IRQ 0
[    0.622131] ACPI: PCI: Interrupt link LNKG configured for IRQ 0
[    0.622171] ACPI: PCI: Interrupt link LNKH configured for IRQ 0
[    0.622950] iommu: Default domain type: Passthrough (set via kernel command line)
[    0.622950] pps_core: LinuxPPS API ver. 1 registered
[    0.622950] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.622950] PTP clock support registered
[    0.622950] EDAC MC: Ver: 3.0.0
[    0.622950] efivars: Registered efivars operations
[    0.622950] NetLabel: Initializing
[    0.622950] NetLabel:  domain hash size = 128
[    0.622950] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.622950] NetLabel:  unlabeled traffic allowed by default
[    0.622950] PCI: Using ACPI for IRQ routing
[    0.627492] PCI: pci_cache_line_size set to 64 bytes
[    0.627558] e820: reserve RAM buffer [mem 0x09d82000-0x0bffffff]
[    0.627560] e820: reserve RAM buffer [mem 0x0a200000-0x0bffffff]
[    0.627561] e820: reserve RAM buffer [mem 0x0b000000-0x0bffffff]
[    0.627562] e820: reserve RAM buffer [mem 0xb7b80000-0xb7ffffff]
[    0.627563] e820: reserve RAM buffer [mem 0xbb118000-0xbbffffff]
[    0.627565] e820: reserve RAM buffer [mem 0xbf000000-0xbfffffff]
[    0.627566] e820: reserve RAM buffer [mem 0x83f380000-0x83fffffff]
[    0.627648] pci 0000:26:00.0: vgaarb: setting as boot VGA device
[    0.627648] pci 0000:26:00.0: vgaarb: bridge control possible
[    0.627648] pci 0000:26:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.627648] vgaarb: loaded
[    0.627648] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.627648] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.629794] clocksource: Switched to clocksource tsc-early
[    0.629940] VFS: Disk quotas dquot_6.6.0
[    0.629958] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.630100] AppArmor: AppArmor Filesystem Enabled
[    0.630114] pnp: PnP ACPI init
[    0.630193] system 00:00: [mem 0xf0000000-0xf7ffffff] has been reserved
[    0.630296] system 00:01: [mem 0xfd200000-0xfd2fffff] has been reserved
[    0.630511] system 00:03: [io  0x0a00-0x0a0f] has been reserved
[    0.630514] system 00:03: [io  0x0a10-0x0a1f] has been reserved
[    0.630515] system 00:03: [io  0x0a20-0x0a2f] has been reserved
[    0.630517] system 00:03: [io  0x0a30-0x0a3f] has been reserved
[    0.630802] pnp 00:04: [dma 0 disabled]
[    0.631124] pnp 00:05: [dma 0 disabled]
[    0.631356] system 00:06: [io  0x04d0-0x04d1] has been reserved
[    0.631359] system 00:06: [io  0x040b] has been reserved
[    0.631360] system 00:06: [io  0x04d6] has been reserved
[    0.631362] system 00:06: [io  0x0c00-0x0c01] has been reserved
[    0.631364] system 00:06: [io  0x0c14] has been reserved
[    0.631366] system 00:06: [io  0x0c50-0x0c51] has been reserved
[    0.631367] system 00:06: [io  0x0c52] has been reserved
[    0.631369] system 00:06: [io  0x0c6c] has been reserved
[    0.631371] system 00:06: [io  0x0c6f] has been reserved
[    0.631373] system 00:06: [io  0x0cd8-0x0cdf] has been reserved
[    0.631374] system 00:06: [io  0x0800-0x089f] has been reserved
[    0.631376] system 00:06: [io  0x0b00-0x0b0f] has been reserved
[    0.631378] system 00:06: [io  0x0b20-0x0b3f] has been reserved
[    0.631380] system 00:06: [io  0x0900-0x090f] has been reserved
[    0.631381] system 00:06: [io  0x0910-0x091f] has been reserved
[    0.631384] system 00:06: [mem 0xfec00000-0xfec00fff] could not be reserved
[    0.631386] system 00:06: [mem 0xfec01000-0xfec01fff] could not be reserved
[    0.631388] system 00:06: [mem 0xfedc0000-0xfedc0fff] has been reserved
[    0.631389] system 00:06: [mem 0xfee00000-0xfee00fff] has been reserved
[    0.631391] system 00:06: [mem 0xfed80000-0xfed8ffff] could not be reserved
[    0.631393] system 00:06: [mem 0xfec10000-0xfec10fff] has been reserved
[    0.631395] system 00:06: [mem 0xff000000-0xffffffff] has been reserved
[    0.631895] pnp: PnP ACPI: found 7 devices
[    0.637719] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.637791] NET: Registered PF_INET protocol family
[    0.637942] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.639976] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    0.640001] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.640005] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.640167] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    0.640293] TCP: Hash tables configured (established 262144 bind 65536)
[    0.640432] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear)
[    0.640472] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    0.640512] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    0.640612] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.640618] NET: Registered PF_XDP protocol family
[    0.640631] pci 0000:21:00.0: BAR 6: assigned [mem 0xfc600000-0xfc60ffff pref]
[    0.640633] pci 0000:20:00.0: PCI bridge to [bus 21]
[    0.640636] pci 0000:20:00.0:   bridge window [io  0xe000-0xefff]
[    0.640641] pci 0000:20:00.0:   bridge window [mem 0xfc600000-0xfc6fffff]
[    0.640650] pci 0000:20:01.0: PCI bridge to [bus 22]
[    0.640653] pci 0000:20:01.0:   bridge window [io  0xd000-0xdfff]
[    0.640658] pci 0000:20:01.0:   bridge window [mem 0xfc500000-0xfc5fffff]
[    0.640666] pci 0000:20:04.0: PCI bridge to [bus 25]
[    0.640678] pci 0000:03:00.2: PCI bridge to [bus 20-25]
[    0.640680] pci 0000:03:00.2:   bridge window [io  0xd000-0xefff]
[    0.640685] pci 0000:03:00.2:   bridge window [mem 0xfc500000-0xfc6fffff]
[    0.640693] pci 0000:00:01.3: PCI bridge to [bus 03-25]
[    0.640695] pci 0000:00:01.3:   bridge window [io  0xd000-0xefff]
[    0.640699] pci 0000:00:01.3:   bridge window [mem 0xfc500000-0xfc7fffff]
[    0.640705] pci 0000:00:03.1: PCI bridge to [bus 26]
[    0.640707] pci 0000:00:03.1:   bridge window [io  0xf000-0xffff]
[    0.640710] pci 0000:00:03.1:   bridge window [mem 0xfb000000-0xfc0fffff]
[    0.640713] pci 0000:00:03.1:   bridge window [mem 0xd0000000-0xe1ffffff 64bit pref]
[    0.640717] pci 0000:00:07.1: PCI bridge to [bus 27]
[    0.640724] pci 0000:00:08.1: PCI bridge to [bus 28]
[    0.640727] pci 0000:00:08.1:   bridge window [mem 0xfc200000-0xfc4fffff]
[    0.640732] pci 0000:00:08.3: PCI bridge to [bus 31]
[    0.640735] pci 0000:00:08.3:   bridge window [mem 0xfc800000-0xfc8fffff]
[    0.640741] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    0.640742] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    0.640744] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    0.640746] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.640747] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000dffff window]
[    0.640749] pci_bus 0000:00: resource 9 [mem 0xc0000000-0xfec2ffff window]
[    0.640751] pci_bus 0000:00: resource 10 [mem 0xfee00000-0xffffffff window]
[    0.640752] pci_bus 0000:03: resource 0 [io  0xd000-0xefff]
[    0.640754] pci_bus 0000:03: resource 1 [mem 0xfc500000-0xfc7fffff]
[    0.640755] pci_bus 0000:20: resource 0 [io  0xd000-0xefff]
[    0.640757] pci_bus 0000:20: resource 1 [mem 0xfc500000-0xfc6fffff]
[    0.640759] pci_bus 0000:21: resource 0 [io  0xe000-0xefff]
[    0.640760] pci_bus 0000:21: resource 1 [mem 0xfc600000-0xfc6fffff]
[    0.640762] pci_bus 0000:22: resource 0 [io  0xd000-0xdfff]
[    0.640764] pci_bus 0000:22: resource 1 [mem 0xfc500000-0xfc5fffff]
[    0.640765] pci_bus 0000:26: resource 0 [io  0xf000-0xffff]
[    0.640767] pci_bus 0000:26: resource 1 [mem 0xfb000000-0xfc0fffff]
[    0.640768] pci_bus 0000:26: resource 2 [mem 0xd0000000-0xe1ffffff 64bit pref]
[    0.640770] pci_bus 0000:28: resource 1 [mem 0xfc200000-0xfc4fffff]
[    0.640772] pci_bus 0000:31: resource 1 [mem 0xfc800000-0xfc8fffff]
[    0.640977] pci 0000:26:00.1: extending delay after power-on from D3hot to 20 msec
[    0.641002] pci 0000:26:00.1: D0 power state depends on 0000:26:00.0
[    0.641125] PCI: CLS 64 bytes, default 64
[    0.641142] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    0.641176] Trying to unpack rootfs image as initramfs...
[    0.641188] pci 0000:00:01.0: Adding to iommu group 0
[    0.641206] pci 0000:00:01.3: Adding to iommu group 1
[    0.641228] pci 0000:00:02.0: Adding to iommu group 2
[    0.641253] pci 0000:00:03.0: Adding to iommu group 3
[    0.641270] pci 0000:00:03.1: Adding to iommu group 4
[    0.641291] pci 0000:00:04.0: Adding to iommu group 5
[    0.641314] pci 0000:00:05.0: Adding to iommu group 6
[    0.641339] pci 0000:00:07.0: Adding to iommu group 7
[    0.641356] pci 0000:00:07.1: Adding to iommu group 8
[    0.641384] pci 0000:00:08.0: Adding to iommu group 9
[    0.641401] pci 0000:00:08.1: Adding to iommu group 10
[    0.641419] pci 0000:00:08.3: Adding to iommu group 11
[    0.641450] pci 0000:00:14.0: Adding to iommu group 12
[    0.641467] pci 0000:00:14.3: Adding to iommu group 12
[    0.641542] pci 0000:00:18.0: Adding to iommu group 13
[    0.641558] pci 0000:00:18.1: Adding to iommu group 13
[    0.641573] pci 0000:00:18.2: Adding to iommu group 13
[    0.641589] pci 0000:00:18.3: Adding to iommu group 13
[    0.641605] pci 0000:00:18.4: Adding to iommu group 13
[    0.641621] pci 0000:00:18.5: Adding to iommu group 13
[    0.641695] pci 0000:00:18.6: Adding to iommu group 13
[    0.641711] pci 0000:00:18.7: Adding to iommu group 13
[    0.641758] pci 0000:03:00.0: Adding to iommu group 14
[    0.641783] pci 0000:03:00.1: Adding to iommu group 14
[    0.641808] pci 0000:03:00.2: Adding to iommu group 14
[    0.641816] pci 0000:20:00.0: Adding to iommu group 14
[    0.641822] pci 0000:20:01.0: Adding to iommu group 14
[    0.641828] pci 0000:20:04.0: Adding to iommu group 14
[    0.641837] pci 0000:21:00.0: Adding to iommu group 14
[    0.641845] pci 0000:22:00.0: Adding to iommu group 14
[    0.641886] pci 0000:26:00.0: Adding to iommu group 15
[    0.641916] pci 0000:26:00.1: Adding to iommu group 15
[    0.641938] pci 0000:27:00.0: Adding to iommu group 16
[    0.641960] pci 0000:28:00.0: Adding to iommu group 17
[    0.641980] pci 0000:28:00.1: Adding to iommu group 18
[    0.642002] pci 0000:28:00.3: Adding to iommu group 19
[    0.642022] pci 0000:28:00.4: Adding to iommu group 20
[    0.642040] pci 0000:31:00.0: Adding to iommu group 21
[    0.642469] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.642470] AMD-Vi: Extended features (0x58f77ef22294a5a, 0x0): PPR NX GT IA PC GA_vAPIC
[    0.642476] AMD-Vi: Interrupt remapping enabled
[    0.642551] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.642553] software IO TLB: mapped [mem 0x00000000b30c0000-0x00000000b70c0000] (64MB)
[    0.642628] LVT offset 0 assigned for vector 0x400
[    0.645749] perf: AMD IBS detected (0x000003ff)
[    0.645755] amd_uncore: 4  amd_df counters detected
[    0.645761] amd_uncore: 6  amd_l3 counters detected
[    0.646019] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[    0.646699] Initialise system trusted keyrings
[    0.646712] Key type blacklist registered
[    0.646741] workingset: timestamp_bits=36 max_order=23 bucket_order=0
[    0.646745] zbud: loaded
[    0.646814] fuse: init (API version 7.39)
[    0.646939] integrity: Platform Keyring initialized
[    0.646944] integrity: Machine keyring initialized
[    0.654801] Key type asymmetric registered
[    0.654806] Asymmetric key parser 'x509' registered
[    1.064480] Freeing initrd memory: 72852K
[    1.067961] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
[    1.067998] io scheduler mq-deadline registered
[    1.069666] pcieport 0000:00:01.3: PME: Signaling with IRQ 27
[    1.069720] pcieport 0000:00:01.3: AER: enabled with IRQ 27
[    1.069854] pcieport 0000:00:03.1: PME: Signaling with IRQ 28
[    1.069912] pcieport 0000:00:03.1: AER: enabled with IRQ 28
[    1.070095] pcieport 0000:00:07.1: PME: Signaling with IRQ 30
[    1.070152] pcieport 0000:00:07.1: AER: enabled with IRQ 30
[    1.070264] pcieport 0000:00:08.1: PME: Signaling with IRQ 31
[    1.070329] pcieport 0000:00:08.1: AER: enabled with IRQ 31
[    1.070485] pcieport 0000:00:08.3: PME: Signaling with IRQ 32
[    1.070534] pcieport 0000:00:08.3: AER: enabled with IRQ 32
[    1.071155] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.071794] Estimated ratio of average max frequency by base frequency (times 1024): 1141
[    1.071806] Monitor-Mwait will be used to enter C-1 state
[    1.071811] ACPI: \_PR_.C000: Found 2 idle states
[    1.071916] ACPI: \_PR_.C002: Found 2 idle states
[    1.072009] ACPI: \_PR_.C004: Found 2 idle states
[    1.072134] ACPI: \_PR_.C006: Found 2 idle states
[    1.072251] ACPI: \_PR_.C008: Found 2 idle states
[    1.072369] ACPI: \_PR_.C00A: Found 2 idle states
[    1.072487] ACPI: \_PR_.C00C: Found 2 idle states
[    1.072606] ACPI: \_PR_.C00E: Found 2 idle states
[    1.072703] ACPI: \_PR_.C001: Found 2 idle states
[    1.072795] ACPI: \_PR_.C003: Found 2 idle states
[    1.072888] ACPI: \_PR_.C005: Found 2 idle states
[    1.073009] ACPI: \_PR_.C007: Found 2 idle states
[    1.073122] ACPI: \_PR_.C009: Found 2 idle states
[    1.073219] ACPI: \_PR_.C00B: Found 2 idle states
[    1.073335] ACPI: \_PR_.C00D: Found 2 idle states
[    1.073451] ACPI: \_PR_.C00F: Found 2 idle states
[    1.073703] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.073883] 00:05: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.074931] serial8250: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    1.075241] Linux agpgart interface v0.103
[    1.123803] tpm_crb MSFT0101:00: Disabling hwrng
[    1.124002] AMD-Vi: AMD IOMMUv2 loaded and initialized
[    1.125028] SPI driver spidev has no spi_device_id for rohm,bh2228fv
[    1.125097] i8042: PNP: No PS/2 controller found.
[    1.125141] mousedev: PS/2 mouse device common for all mice
[    1.125159] rtc_cmos 00:02: RTC can wake from S4
[    1.125373] rtc_cmos 00:02: registered as rtc0
[    1.125401] rtc_cmos 00:02: setting system clock to 2024-11-19T02:37:52 UTC (1731983872)
[    1.125425] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram
[    1.125433] amd_pstate: driver load is disabled, boot with specific mode to enable this
[    1.125522] ledtrig-cpu: registered to indicate activity on CPUs
[    1.125784] efifb: probing for efifb
[    1.125790] efifb: framebuffer at 0xd0000000, using 2432k, total 2432k
[    1.125791] efifb: mode is 800x600x32, linelength=4096, pages=1
[    1.125793] efifb: scrolling: redraw
[    1.125793] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    1.126151] Console: switching to colour frame buffer device 100x37
[    1.126427] fb0: EFI VGA frame buffer device
[    1.136649] NET: Registered PF_INET6 protocol family
[    1.139786] Segment Routing with IPv6
[    1.139797] In-situ OAM (IOAM) with IPv6
[    1.139823] mip6: Mobile IPv6
[    1.139825] NET: Registered PF_PACKET protocol family
[    1.139851] mpls_gso: MPLS GSO support
[    1.140930] microcode: CPU1: patch_level=0x08701030
[    1.140930] microcode: CPU0: patch_level=0x08701030
[    1.140931] microcode: CPU3: patch_level=0x08701030
[    1.140933] microcode: CPU4: patch_level=0x08701030
[    1.140933] microcode: CPU5: patch_level=0x08701030
[    1.140934] microcode: CPU6: patch_level=0x08701030
[    1.140934] microcode: CPU8: patch_level=0x08701030
[    1.140934] microcode: CPU7: patch_level=0x08701030
[    1.140935] microcode: CPU9: patch_level=0x08701030
[    1.140936] microcode: CPU10: patch_level=0x08701030
[    1.140936] microcode: CPU11: patch_level=0x08701030
[    1.140938] microcode: CPU12: patch_level=0x08701030
[    1.140939] microcode: CPU2: patch_level=0x08701030
[    1.140939] microcode: CPU13: patch_level=0x08701030
[    1.140940] microcode: CPU14: patch_level=0x08701030
[    1.140942] microcode: CPU15: patch_level=0x08701030
[    1.140962] microcode: Microcode Update Driver: v2.2.
[    1.141072] resctrl: L3 allocation detected
[    1.141073] resctrl: MB allocation detected
[    1.141074] resctrl: L3 monitoring detected
[    1.141077] IPI shorthand broadcast: enabled
[    1.142489] sched_clock: Marking stable (828861435, 312201939)->(1149214692, -8151318)
[    1.142568] registered taskstats version 1
[    1.142747] Loading compiled-in X.509 certificates
[    1.155140] Loaded X.509 cert 'Debian Secure Boot CA: 6ccece7e4c6c0d1f6149f3dd27dfcc5cbb419ea1'
[    1.155170] Loaded X.509 cert 'Debian Secure Boot Signer 2020: 00b55eb3b9'
[    1.156750] Key type .fscrypt registered
[    1.156758] Key type fscrypt-provisioning registered
[    1.159507] Key type encrypted registered
[    1.159517] AppArmor: AppArmor sha1 policy hashing enabled
[    1.159581] integrity: Loading X.509 certificate: UEFI:db
[    1.159599] integrity: Loaded X.509 cert 'Microsoft Corporation UEFI CA 2011: 13adbf4309bd82709c8cd54f316ed522988a1bd4'
[    1.159614] integrity: Loading X.509 certificate: UEFI:db
[    1.159630] integrity: Loaded X.509 cert 'Microsoft Windows Production PCA 2011: a92902398e16c49778cd90f99e4f9ae17c55af53'
[    1.160047] blacklist: Duplicate blacklisted hash bin:47ff1b63b140b6fc04ed79131331e651da5b2e2f170f5daef4153dc2fbc532b1
[    1.160064] blacklist: Duplicate blacklisted hash bin:5391c3a2fb112102a6aa1edc25ae77e19f5d6f09cd09eeb2509922bfcd5992ea
[    1.160579] blacklist: Duplicate blacklisted hash bin:80b4d96931bf0d02fd91a61e19d14f1da452e66db2408ca8604d411f92659f0a
[    1.161089] blacklist: Duplicate blacklisted hash bin:992d359aa7a5f789d268b94c11b9485a6b1ce64362b0edb4441ccc187c39647b
[    1.161628] blacklist: Duplicate blacklisted hash bin:c452ab846073df5ace25cca64d6b7a09d906308a1a65eb5240e3c4ebcaa9cc0c
[    1.162152] blacklist: Duplicate blacklisted hash bin:e051b788ecbaeda53046c70e6af6058f95222c046157b8c4c1b9c2cfc65f46e5
[    1.162696] ima: Allocated hash algorithm: sha256
[    1.293671] ima: No architecture policies found
[    1.293685] evm: Initialising EVM extended attributes:
[    1.293686] evm: security.selinux
[    1.293687] evm: security.SMACK64 (disabled)
[    1.293688] evm: security.SMACK64EXEC (disabled)
[    1.293689] evm: security.SMACK64TRANSMUTE (disabled)
[    1.293690] evm: security.SMACK64MMAP (disabled)
[    1.293692] evm: security.apparmor
[    1.293693] evm: security.ima
[    1.293694] evm: security.capability
[    1.293695] evm: HMAC attrs: 0x1
[    1.387276] RAS: Correctable Errors collector initialized.
[    1.387421] clk: Disabling unused clocks
[    1.388869] Freeing unused decrypted memory: 2028K
[    1.389357] Freeing unused kernel image (initmem) memory: 3964K
[    1.389359] Write protecting the kernel read-only data: 28672k
[    1.389845] Freeing unused kernel image (rodata/data gap) memory: 1792K
[    1.443546] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.443551] Run /init as init process
[    1.443552]   with arguments:
[    1.443553]     /init
[    1.443554]   with environment:
[    1.443555]     HOME=/
[    1.443556]     TERM=linux
[    1.443557]     BOOT_IMAGE=/ROOT/24.10.0.2@/boot/vmlinuz-6.6.44-production+truenas
[    1.443558]     zfsforce=1
[    1.563827] gpio_generic: module verification failed: signature and/or required key missing - tainting kernel
[    1.573103] SCSI subsystem initialized
[    1.575139] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0
[    1.575143] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[    1.575247] piix4_smbus 0000:00:14.0: Auxiliary SMBus Host Controller at 0xb20
[    1.579722] ACPI: bus type USB registered
[    1.579752] usbcore: registered new interface driver usbfs
[    1.579765] usbcore: registered new interface driver hub
[    1.579789] usbcore: registered new device driver usb
[    1.584168] libata version 3.00 loaded.
[    1.589796] xhci_hcd 0000:03:00.0: xHCI Host Controller
[    1.589802] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 1
[    1.590071] ahci 0000:03:00.1: version 3.0
[    1.590195] ahci 0000:03:00.1: SSS flag set, parallel bus scan disabled
[    1.590237] ahci 0000:03:00.1: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0x33 impl SATA mode
[    1.590240] ahci 0000:03:00.1: flags: 64bit ncq sntf stag pm led clo only pmp pio slum part sxs deso sadm sds apst 
[    1.606435] r8169 0000:21:00.0 eth0: RTL8125B, a0:36:9f:52:73:36, XID 641, IRQ 39
[    1.606440] r8169 0000:21:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko]
[    1.622123] r8169 0000:22:00.0 eth1: RTL8168h/8111h, d8:bb:c1:02:93:f9, XID 541, IRQ 40
[    1.622126] r8169 0000:22:00.0 eth1: jumbo features [frames: 9194 bytes, tx checksumming: ko]
[    1.645125] xhci_hcd 0000:03:00.0: hcc params 0x0200ef81 hci version 0x110 quirks 0x0000000000000410
[    1.645366] xhci_hcd 0000:03:00.0: xHCI Host Controller
[    1.645369] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 2
[    1.645371] xhci_hcd 0000:03:00.0: Host supports USB 3.1 Enhanced SuperSpeed
[    1.645433] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.06
[    1.645435] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.645437] usb usb1: Product: xHCI Host Controller
[    1.645439] usb usb1: Manufacturer: Linux 6.6.44-production+truenas xhci-hcd
[    1.645440] usb usb1: SerialNumber: 0000:03:00.0
[    1.645596] hub 1-0:1.0: USB hub found
[    1.645611] hub 1-0:1.0: 10 ports detected
[    1.646034] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.646055] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.06
[    1.646057] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.646058] usb usb2: Product: xHCI Host Controller
[    1.646060] usb usb2: Manufacturer: Linux 6.6.44-production+truenas xhci-hcd
[    1.646061] usb usb2: SerialNumber: 0000:03:00.0
[    1.646160] hub 2-0:1.0: USB hub found
[    1.646168] hub 2-0:1.0: 4 ports detected
[    1.646334] scsi host0: ahci
[    1.646434] xhci_hcd 0000:28:00.3: xHCI Host Controller
[    1.646438] xhci_hcd 0000:28:00.3: new USB bus registered, assigned bus number 3
[    1.646478] scsi host1: ahci
[    1.646541] xhci_hcd 0000:28:00.3: hcc params 0x0278ffe5 hci version 0x110 quirks 0x0000000000000410
[    1.646578] scsi host2: ahci
[    1.646687] scsi host3: ahci
[    1.646782] scsi host4: ahci
[    1.646880] scsi host5: ahci
[    1.646926] xhci_hcd 0000:28:00.3: xHCI Host Controller
[    1.646928] xhci_hcd 0000:28:00.3: new USB bus registered, assigned bus number 4
[    1.646931] xhci_hcd 0000:28:00.3: Host supports USB 3.1 Enhanced SuperSpeed
[    1.646962] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.06
[    1.646964] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.646966] usb usb3: Product: xHCI Host Controller
[    1.646967] usb usb3: Manufacturer: Linux 6.6.44-production+truenas xhci-hcd
[    1.646969] usb usb3: SerialNumber: 0000:28:00.3
[    1.646978] scsi host6: ahci
[    1.647058] hub 3-0:1.0: USB hub found
[    1.647066] hub 3-0:1.0: 4 ports detected
[    1.647085] scsi host7: ahci
[    1.647140] ata1: SATA max UDMA/133 abar m131072@0xfc780000 port 0xfc780100 irq 38
[    1.647142] ata2: SATA max UDMA/133 abar m131072@0xfc780000 port 0xfc780180 irq 38
[    1.647144] ata3: DUMMY
[    1.647145] ata4: DUMMY
[    1.647146] ata5: SATA max UDMA/133 abar m131072@0xfc780000 port 0xfc780300 irq 38
[    1.647149] ata6: SATA max UDMA/133 abar m131072@0xfc780000 port 0xfc780380 irq 38
[    1.647150] ata7: DUMMY
[    1.647151] ata8: DUMMY
[    1.647224] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.647244] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.06
[    1.647246] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.647247] usb usb4: Product: xHCI Host Controller
[    1.647249] usb usb4: Manufacturer: Linux 6.6.44-production+truenas xhci-hcd
[    1.647250] usb usb4: SerialNumber: 0000:28:00.3
[    1.647334] hub 4-0:1.0: USB hub found
[    1.647341] hub 4-0:1.0: 4 ports detected
[    1.647523] ahci 0000:31:00.0: AHCI 0001.0301 32 slots 2 ports 6 Gbps 0x30 impl SATA mode
[    1.647527] ahci 0000:31:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part 
[    1.648106] scsi host8: ahci
[    1.648257] scsi host9: ahci
[    1.648355] scsi host10: ahci
[    1.648453] scsi host11: ahci
[    1.648552] scsi host12: ahci
[    1.648649] scsi host13: ahci
[    1.648697] ata9: DUMMY
[    1.648698] ata10: DUMMY
[    1.648699] ata11: DUMMY
[    1.648700] ata12: DUMMY
[    1.648702] ata13: SATA max UDMA/133 abar m2048@0xfc800000 port 0xfc800300 irq 56
[    1.648704] ata14: SATA max UDMA/133 abar m2048@0xfc800000 port 0xfc800380 irq 57
[    1.664211] tsc: Refined TSC clocksource calibration: 3599.998 MHz
[    1.664220] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x33e451ab1a6, max_idle_ns: 440795278720 ns
[    1.664246] clocksource: Switched to clocksource tsc
[    1.676216] r8169 0000:21:00.0 eno1: renamed from eth0
[    1.704303] r8169 0000:22:00.0 enp34s0: renamed from eth1
[    1.968259] usb 1-7: new full-speed USB device number 2 using xhci_hcd
[    2.124679] ata14: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.124681] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.124701] ata13: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.125453] ata13.00: ATA-11: Lexar 240GB SSD, V3.0.8, max UDMA/133
[    2.125488] ata13.00: 468862128 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    2.125683] ata1.00: supports DRM functions and may not be fully accessible
[    2.125995] ata1.00: ATA-9: HUH721212ALE601, LEGL0002, max UDMA/133
[    2.126322] ata13.00: configured for UDMA/133
[    2.126350] ata14.00: ATA-9: T-FORCE 240GB, W0714A0, max UDMA/133
[    2.127330] ata14.00: 468862128 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    2.131513] ata14.00: configured for UDMA/133
[    2.134289] ata1.00: 23437770752 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    2.139036] ata1.00: Features: Trust NCQ-sndrcv NCQ-prio
[    2.142389] ata1.00: supports DRM functions and may not be fully accessible
[    2.152944] ata1.00: configured for UDMA/133
[    2.153069] scsi 0:0:0:0: Direct-Access     ATA      HUH721212ALE601  0002 PQ: 0 ANSI: 5
[    2.364888] usb 1-7: New USB device found, idVendor=2516, idProduct=0051, bcdDevice=11.01
[    2.364894] usb 1-7: New USB device strings: Mfr=3, Product=1, SerialNumber=0
[    2.364896] usb 1-7: Product: AMD SR4 lamplight Control
[    2.364898] usb 1-7: Manufacturer: Cooler Master Technology Inc.
[    2.628678] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.636606] ata2.00: ATA-9: ADATA SU655, Y201229a, max UDMA/133
[    2.636639] ata2.00: 234441648 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    2.637433] ata2.00: configured for UDMA/133
[    2.637585] scsi 1:0:0:0: Direct-Access     ATA      ADATA SU655      229a PQ: 0 ANSI: 5
[    2.949575] ata5: SATA link down (SStatus 0 SControl 330)
[    3.424689] ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    3.425775] ata6.00: supports DRM functions and may not be fully accessible
[    3.426092] ata6.00: ATA-9: HUH721212ALE601, LEGL0002, max UDMA/133
[    3.434660] ata6.00: 23437770752 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    3.440708] ata6.00: Features: Trust NCQ-sndrcv NCQ-prio
[    3.445039] ata6.00: supports DRM functions and may not be fully accessible
[    3.456287] ata6.00: configured for UDMA/133
[    3.456520] scsi 5:0:0:0: Direct-Access     ATA      HUH721212ALE601  0002 PQ: 0 ANSI: 5
[    3.457244] scsi 12:0:0:0: Direct-Access     ATA      Lexar 240GB SSD  .8   PQ: 0 ANSI: 5
[    3.457754] scsi 13:0:0:0: Direct-Access     ATA      T-FORCE 240GB    4A0  PQ: 0 ANSI: 5
[    3.464932] hid: raw HID events driver (C) Jiri Kosina
[    3.468514] sd 1:0:0:0: [sda] 234441648 512-byte logical blocks: (120 GB/112 GiB)
[    3.468533] sd 5:0:0:0: [sdb] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
[    3.468533] sd 0:0:0:0: [sdc] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
[    3.468535] sd 12:0:0:0: [sdd] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[    3.468536] sd 5:0:0:0: [sdb] 4096-byte physical blocks
[    3.468539] sd 13:0:0:0: [sde] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[    3.468542] sd 12:0:0:0: [sdd] Write Protect is off
[    3.468543] sd 12:0:0:0: [sdd] Mode Sense: 00 3a 00 00
[    3.468544] sd 5:0:0:0: [sdb] Write Protect is off
[    3.468546] sd 5:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    3.468546] sd 13:0:0:0: [sde] Write Protect is off
[    3.468548] sd 13:0:0:0: [sde] Mode Sense: 00 3a 00 00
[    3.468552] sd 12:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.468558] sd 5:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.468559] sd 13:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.468566] sd 12:0:0:0: [sdd] Preferred minimum I/O size 512 bytes
[    3.468575] sd 13:0:0:0: [sde] Preferred minimum I/O size 512 bytes
[    3.468585] sd 5:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes
[    3.468785] sd 1:0:0:0: [sda] Write Protect is off
[    3.469055] sd 0:0:0:0: [sdc] 4096-byte physical blocks
[    3.469313] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.469571] sd 0:0:0:0: [sdc] Write Protect is off
[    3.469826] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.469947]  sde: sde1
[    3.470027] sd 13:0:0:0: [sde] Attached SCSI disk
[    3.470080] sd 0:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    3.470324]  sdd: sdd1
[    3.470343] sd 1:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[    3.470383] sd 12:0:0:0: [sdd] Attached SCSI disk
[    3.470592] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.474395] sd 0:0:0:0: [sdc] Preferred minimum I/O size 4096 bytes
[    3.479243]  sda: sda1 sda2 sda3 sda4
[    3.479386] sd 1:0:0:0: [sda] Attached SCSI disk
[    3.480725] usbcore: registered new interface driver usbhid
[    3.480728] usbhid: USB HID core driver
[    3.507584]  sdb: sdb1
[    3.508678] sd 5:0:0:0: [sdb] Attached SCSI disk
[    3.515517]  sdc: sdc1
[    3.516619] sd 0:0:0:0: [sdc] Attached SCSI disk
[    3.517932] input: Cooler Master Technology Inc. AMD SR4 lamplight Control as /devices/pci0000:00/0000:00:01.3/0000:03:00.0/usb1/1-7/1-7:1.0/0003:2516:0051.0001/input/input0
[    3.576318] hid-generic 0003:2516:0051.0001: input,hidraw0: USB HID v1.11 Keyboard [Cooler Master Technology Inc. AMD SR4 lamplight Control] on usb-0000:03:00.0-7/input0
[    3.576439] hid-generic 0003:2516:0051.0002: hiddev0,hidraw1: USB HID v1.11 Device [Cooler Master Technology Inc. AMD SR4 lamplight Control] on usb-0000:03:00.0-7/input1
[    3.576537] input: Cooler Master Technology Inc. AMD SR4 lamplight Control System Control as /devices/pci0000:00/0000:00:01.3/0000:03:00.0/usb1/1-7/1-7:1.2/0003:2516:0051.0003/input/input1
[    3.636247] input: Cooler Master Technology Inc. AMD SR4 lamplight Control Consumer Control as /devices/pci0000:00/0000:00:01.3/0000:03:00.0/usb1/1-7/1-7:1.2/0003:2516:0051.0003/input/input2
[    3.636282] hid-generic 0003:2516:0051.0003: input,hidraw2: USB HID v1.11 Device [Cooler Master Technology Inc. AMD SR4 lamplight Control] on usb-0000:03:00.0-7/input2
[    3.744397] spl: loading out-of-tree module taints kernel.
[    3.759613] zfs: module license 'CDDL' taints kernel.
[    3.759838] Disabling lock debugging due to kernel taint
[    3.760073] zfs: module license taints kernel.
[    5.716654] ZFS: Loaded module v2.2.99-1, ZFS pool version 5000, ZFS filesystem version 5
[    6.880181] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[    6.979656] systemd[1]: Inserted module 'autofs4'
[    6.997568] systemd[1]: systemd 252.26-1~deb12u2 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    6.997580] systemd[1]: Detected architecture x86-64.
[    6.999678] systemd[1]: Hostname set to <truenas>.
[    7.173646] systemd[1]: Queued start job for default target truenas.target.
[    7.197687] systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe.
[    7.198256] systemd[1]: Created slice user.slice - User and Session Slice.
[    7.198517] systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[    7.198813] systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
[    7.199161] systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
[    7.199402] systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes.
[    7.199629] systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes.
[    7.199864] systemd[1]: Reached target paths.target - Path Units.
[    7.200093] systemd[1]: Reached target slices.target - Slice Units.
[    7.200354] systemd[1]: Reached target swap.target - Swaps.
[    7.200580] systemd[1]: Reached target time-set.target - System Time Set.
[    7.200814] systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes.
[    7.201449] systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket.
[    7.205521] systemd[1]: Listening on rpcbind.socket - RPCbind Server Activation Socket.
[    7.206791] systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket.
[    7.207054] systemd[1]: Listening on systemd-initctl.socket - initctl Compatibility Named Pipe.
[    7.207440] systemd[1]: Listening on systemd-journald-audit.socket - Journal Audit Socket.
[    7.207744] systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[    7.208052] systemd[1]: Listening on systemd-journald.socket - Journal Socket.
[    7.208864] systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket.
[    7.209158] systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[    7.210281] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[    7.211320] systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
[    7.212428] systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
[    7.213522] systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
[    7.214712] systemd[1]: Mounting tmp.mount - Temporary Directory (/tmp)...
[    7.215026] systemd[1]: auth-rpcgss-module.service - Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[    7.216137] systemd[1]: Starting dbus.service - D-Bus System Message Bus...
[    7.216483] systemd[1]: ix-boot-core.service - Reboot to TrueNAS core was skipped because of an unmet condition check (ConditionEnvironment=_BOOT_TRUENAS_CORE=1).
[    7.217430] systemd[1]: Starting ix-wait-on-disks.service - Wait on Disk Enumeration...
[    7.219099] systemd[1]: Starting keyboard-setup.service - Set the console keyboard layout...
[    7.220264] systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes...
[    7.221343] systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs...
[    7.222390] systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod...
[    7.223528] systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm...
[    7.224661] systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore...
[    7.225740] systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse...
[    7.226859] systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop...
[    7.228662] systemd[1]: Starting systemd-journald.service - Journal Service...
[    7.229863] systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems...
[    7.229990] pstore: Using crash dump compression: deflate
[    7.231120] systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices...
[    7.231555] pstore: Registered efi_pstore as persistent store backend
[    7.233039] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[    7.233411] systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
[    7.233703] loop: module loaded
[    7.233725] systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
[    7.234020] systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
[    7.234318] systemd[1]: Mounted tmp.mount - Temporary Directory (/tmp).
[    7.234793] systemd[1]: Finished keyboard-setup.service - Set the console keyboard layout.
[    7.235296] systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes.
[    7.235981] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[    7.236102] systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs.
[    7.236586] systemd[1]: modprobe@dm_mod.service: Deactivated successfully.
[    7.236701] systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod.
[    7.237162] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[    7.237283] systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore.
[    7.237726] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[    7.237845] systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse.
[    7.238335] systemd[1]: modprobe@loop.service: Deactivated successfully.
[    7.238460] systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop.
[    7.238913] systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems.
[    7.240502] systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System...
[    7.241874] systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System...
[    7.242260] systemd[1]: systemd-firstboot.service - First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[    7.242324] systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
[    7.243410] systemd[1]: Starting systemd-random-seed.service - Load/Save Random Seed...
[    7.243738] systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met.
[    7.244720] systemd[1]: Starting systemd-sysusers.service - Create System Users...
[    7.246199] systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System.
[    7.246568] systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System.
[    7.255284] ACPI: bus type drm_connector registered
[    7.256309] systemd[1]: modprobe@drm.service: Deactivated successfully.
[    7.256445] systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm.
[    7.280999] systemd[1]: Started dbus.service - D-Bus System Message Bus.
[    7.285740] systemd[1]: Finished systemd-random-seed.service - Load/Save Random Seed.
[    7.286036] systemd[1]: first-boot-complete.target - First Boot Complete was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[    7.286295] systemd[1]: Started systemd-journald.service - Journal Service.
[    7.293138] systemd-journald[795]: Received client request to flush runtime journal.
[    7.324858] systemd-journald[795]: Data hash table of /var/log/journal/8c819acc7b3f4d288c180589905ec844/system.journal has a fill level at 81.0 (9214 of 11377 items, 6553600 file size, 711 bytes per hash table item), suggesting rotation.
[    7.324864] systemd-journald[795]: /var/log/journal/8c819acc7b3f4d288c180589905ec844/system.journal: Journal header limits reached or header out-of-date, rotating.
[    7.435305] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input3
[    7.435388] ACPI: button: Power Button [PWRB]
[    7.435492] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[    7.435597] ACPI: button: Power Button [PWRF]
[    7.440665] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    7.441907] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    7.443973] sd 5:0:0:0: Attached scsi generic sg2 type 0
[    7.445299] sd 12:0:0:0: Attached scsi generic sg3 type 0
[    7.449153] sd 13:0:0:0: Attached scsi generic sg4 type 0
[    7.453415] parport_pc 00:04: reported by Plug and Play ACPI
[    7.455344] parport0: PC-style at 0x378, irq 5 [PCSPP]
[    7.458966] ccp 0000:28:00.1: enabling device (0000 -> 0002)
[    7.459526] input: PC Speaker as /devices/platform/pcspkr/input/input5
[    7.460128] sp5100_tco: SP5100/SB800 TCO WatchDog Timer Driver
[    7.460423] sp5100-tco sp5100-tco: Using 0xfeb00000 for watchdog MMIO address
[    7.460616] ccp 0000:28:00.1: ccp: unable to access the device: you might be running a broken BIOS.
[    7.460621] acpi_cpufreq: overriding BIOS provided _PSD data
[    7.461112] ccp 0000:28:00.1: psp enabled
[    7.463865] sp5100-tco sp5100-tco: initialized. heartbeat=60 sec (nowayout=0)
[    7.510343] Error: Driver 'pcspkr' is already registered, aborting...
[    7.528871] RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer
[    7.528876] RAPL PMU: hw unit of domain package 2^-16 Joules
[    7.636475] snd_hda_intel 0000:26:00.1: Disabling MSI
[    7.636488] snd_hda_intel 0000:26:00.1: Handle vga_switcheroo audio client
[    7.636580] snd_hda_intel 0000:28:00.4: enabling device (0000 -> 0002)
[    7.636791] cryptd: max_cpu_qlen set to 1000
[    7.636918] ppdev: user-space parallel port driver
[    7.640172] AVX2 version of gcm_enc/dec engaged.
[    7.640263] AES CTR mode by8 optimization enabled
[    7.656721] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:03.1/0000:26:00.1/sound/card0/input6
[    7.656793] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:03.1/0000:26:00.1/sound/card0/input7
[    7.656849] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:03.1/0000:26:00.1/sound/card0/input8
[    7.656904] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:03.1/0000:26:00.1/sound/card0/input9
[    7.657646] snd_hda_codec_realtek hdaudioC1D0: autoconfig for ALC897: line_outs=4 (0x14/0x15/0x16/0x17/0x0) type:line
[    7.657651] snd_hda_codec_realtek hdaudioC1D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    7.657653] snd_hda_codec_realtek hdaudioC1D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    7.657655] snd_hda_codec_realtek hdaudioC1D0:    mono: mono_out=0x0
[    7.657656] snd_hda_codec_realtek hdaudioC1D0:    inputs:
[    7.657658] snd_hda_codec_realtek hdaudioC1D0:      Front Mic=0x19
[    7.657660] snd_hda_codec_realtek hdaudioC1D0:      Rear Mic=0x18
[    7.657661] snd_hda_codec_realtek hdaudioC1D0:      Line=0x1a
[    7.672982] input: HD-Audio Generic Front Mic as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input10
[    7.673041] input: HD-Audio Generic Rear Mic as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input11
[    7.673096] input: HD-Audio Generic Line as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input12
[    7.673140] input: HD-Audio Generic Line Out Front as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input13
[    7.673181] input: HD-Audio Generic Line Out Surround as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input14
[    7.673242] input: HD-Audio Generic Line Out CLFE as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input15
[    7.673381] input: HD-Audio Generic Line Out Side as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input16
[    7.673644] input: HD-Audio Generic Front Headphone as /devices/pci0000:00/0000:00:08.1/0000:28:00.4/sound/card1/input17
[    7.742646] kvm_amd: TSC scaling supported
[    7.742648] kvm_amd: Nested Virtualization enabled
[    7.742649] kvm_amd: Nested Paging enabled
[    7.742651] kvm_amd: LBR virtualization supported
[    7.742652] kvm_amd: SEV enabled (ASIDs 1 - 509)
[    7.742653] kvm_amd: SEV-ES disabled (ASIDs 0 - 0)
[    7.742676] kvm_amd: AVIC enabled
[    7.742677] kvm_amd: Virtual VMLOAD VMSAVE supported
[    7.742678] kvm_amd: Virtual GIF supported
[    7.748745] MCE: In-kernel MCE decoding enabled.
[    7.869389] intel_rapl_common: Found RAPL domain package
[    7.869393] intel_rapl_common: Found RAPL domain core
[   32.067466] systemd[1]: memfd_create() called without MFD_EXEC or MFD_NOEXEC_SEAL set
[   32.116217] ata5: link is slow to respond, please be patient (ready=0)
[   36.396237] ata5: found unknown device (class 0)
[   36.556505] ata5: softreset failed (device not ready)
[   42.078244] dca service started, version 1.12.1
[   42.080446] ioatdma: Intel(R) QuickData Technology Driver 5.00
[   42.083083] NTB Resource Split driver, version 1
[   42.084588] Software Queue-Pair Transport over NTB, version 4
[   42.096303] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[   42.300217] ata5: link is slow to respond, please be patient (ready=0)
[   44.116245] RTL8226B_RTL8221B 2.5Gbps PHY r8169-0-2100:00: attached PHY driver (mii_bus:phy_addr=r8169-0-2100:00, irq=MAC)
[   44.316364] r8169 0000:21:00.0 eno1: Link is Down
[   44.392231] Generic FE-GE Realtek PHY r8169-0-2200:00: attached PHY driver (mii_bus:phy_addr=r8169-0-2200:00, irq=MAC)
[   44.588323] r8169 0000:22:00.0 enp34s0: Link is Down
[   45.044223] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
[   45.062902] ata5.00: supports DRM functions and may not be fully accessible
[   45.063208] ata5.00: ATA-9: HUH721212ALE601, LEGL0002, max UDMA/133
[   45.071066] ata5.00: 23437770752 sectors, multi 0: LBA48 NCQ (depth 32), AA
[   45.075862] ata5.00: Features: Trust NCQ-sndrcv NCQ-prio
[   45.079159] ata5.00: supports DRM functions and may not be fully accessible
[   45.089807] ata5.00: configured for UDMA/133
[   45.089950] scsi 4:0:0:0: Direct-Access     ATA      HUH721212ALE601  0002 PQ: 0 ANSI: 5
[   45.090835] sd 4:0:0:0: Attached scsi generic sg5 type 0
[   45.090868] sd 4:0:0:0: [sdf] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
[   45.091556] sd 4:0:0:0: [sdf] 4096-byte physical blocks
[   45.091802] sd 4:0:0:0: [sdf] Write Protect is off
[   45.092036] sd 4:0:0:0: [sdf] Mode Sense: 00 3a 00 00
[   45.092046] sd 4:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   45.092543] sd 4:0:0:0: [sdf] Preferred minimum I/O size 4096 bytes
[   45.138870]  sdf: sdf1
[   45.140000] sd 4:0:0:0: [sdf] Attached SCSI disk
[   47.705703] r8169 0000:21:00.0 eno1: Link is Up - 2.5Gbps/Full - flow control off
[   76.256731] audit: type=1400 audit(1731983947.626:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=3481 comm="apparmor_parser"
[   76.257222] audit: type=1400 audit(1731983947.626:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=3481 comm="apparmor_parser"
[   76.257703] audit: type=1400 audit(1731983947.626:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=3480 comm="apparmor_parser"
[   76.258207] audit: type=1400 audit(1731983947.626:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=3483 comm="apparmor_parser"
[   76.258717] audit: type=1400 audit(1731983947.626:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=3483 comm="apparmor_parser"
[   76.259247] audit: type=1400 audit(1731983947.626:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=3483 comm="apparmor_parser"
[   76.259782] audit: type=1400 audit(1731983947.626:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="virt-aa-helper" pid=3485 comm="apparmor_parser"
[   76.260346] audit: type=1400 audit(1731983947.626:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libvirtd" pid=3488 comm="apparmor_parser"
[   76.260993] audit: type=1400 audit(1731983947.626:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libvirtd//qemu_bridge_helper" pid=3488 comm="apparmor_parser"
[   76.262607] audit: type=1400 audit(1731983947.630:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/chronyd" pid=3486 comm="apparmor_parser"
[   76.300444] RPC: Registered named UNIX socket transport module.
[   76.300446] RPC: Registered udp transport module.
[   76.300447] RPC: Registered tcp transport module.
[   76.300448] RPC: Registered tcp-with-tls transport module.
[   76.300449] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   81.662053] kauditd_printk_skb: 6 callbacks suppressed
[   81.662056] audit: type=1400 audit(1731983953.057:18): apparmor="STATUS" operation="profile_load" profile="unconfined" name="docker-default" pid=7929 comm="apparmor_parser"
[   81.867585] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   81.868703] Bridge firewalling registered
[   82.022115] Initializing XFRM netlink socket
[   82.547748] br-dccce11d8f66: port 1(vethac28d32) entered blocking state
[   82.547754] br-dccce11d8f66: port 1(vethac28d32) entered disabled state
[   82.547766] vethac28d32: entered allmulticast mode
[   82.547809] vethac28d32: entered promiscuous mode
[   82.547905] br-dccce11d8f66: port 1(vethac28d32) entered blocking state
[   82.547908] br-dccce11d8f66: port 1(vethac28d32) entered forwarding state
[   82.548031] br-dccce11d8f66: port 1(vethac28d32) entered disabled state
[   82.562918] br-dccce11d8f66: port 2(vethc065c4d) entered blocking state
[   82.562924] br-dccce11d8f66: port 2(vethc065c4d) entered disabled state
[   82.562931] vethc065c4d: entered allmulticast mode
[   82.562974] vethc065c4d: entered promiscuous mode
[   82.563046] br-dccce11d8f66: port 2(vethc065c4d) entered blocking state
[   82.563048] br-dccce11d8f66: port 2(vethc065c4d) entered forwarding state
[   82.947301] br-dccce11d8f66: port 2(vethc065c4d) entered disabled state
[   82.947712] vethc065c4d (unregistering): left allmulticast mode
[   82.947715] vethc065c4d (unregistering): left promiscuous mode
[   82.947718] br-dccce11d8f66: port 2(vethc065c4d) entered disabled state
[   82.979060] eth0: renamed from veth298eae4
[   83.011668] br-dccce11d8f66: port 1(vethac28d32) entered blocking state
[   83.011672] br-dccce11d8f66: port 1(vethac28d32) entered forwarding state
[  217.413034] WARNING: can't open objset 54, error 5
[  219.562940] WARNING: can't open objset 54, error 5
[  320.144866] veth298eae4: renamed from eth0
[  320.200567] br-dccce11d8f66: port 1(vethac28d32) entered disabled state
[  320.251703] br-dccce11d8f66: port 1(vethac28d32) entered disabled state
[  320.252254] vethac28d32 (unregistering): left allmulticast mode
[  320.252256] vethac28d32 (unregistering): left promiscuous mode
[  320.252259] br-dccce11d8f66: port 1(vethac28d32) entered disabled state
[  347.083203] WARNING: can't open objset 54, error 5
[  349.198924] WARNING: can't open objset 54, error 5
[  736.535362] WARNING: can't open objset 54, error 5
[  738.594158] WARNING: can't open objset 54, error 5
[  969.371646] WARNING: can't open objset 54, error 5
[  971.413047] WARNING: can't open objset 54, error 5
[ 1138.255059] WARNING: can't open objset 54, error 5
[ 1140.388458] WARNING: can't open objset 54, error 5
[ 1694.070095] WARNING: can't open objset 54, error 5
[ 1696.161711] WARNING: can't open objset 54, error 5
[ 1728.019068] WARNING: can't open objset 54, error 5
[ 1730.235880] WARNING: can't open objset 54, error 5
root@truenas[/home/admin]#

        
Nov 18 2024 22:06:44.426859482 ereport.fs.zfs.data
        class = "ereport.fs.zfs.data"
        ena = 0x19369942ec400001
        detector = (embedded nvlist)
                version = 0x0
                scheme = "zfs"
                pool = 0x4698d52776b844d5
        (end detector)
        pool = "tank"
        pool_guid = 0x4698d52776b844d5
        pool_state = 0x0
        pool_context = 0x2
        pool_failmode = "continue"
        zio_err = 0x34
        zio_flags = 0x808081 [DONT_AGGREGATE CANFAIL IO_RETRY RAW_COMPRESS]
        zio_stage = 0x2000000 [DONE]
        zio_pipeline = 0x2100000 [READY DONE]
        zio_delay = 0x0
        zio_timestamp = 0x0
        zio_delta = 0x0
        zio_priority = 0x0 [SYNC_READ]
        zio_objset = 0x0
        zio_object = 0x0
        zio_level = 0x0
        zio_blkid = 0x168
        time = 0x673c00c4 0x19715bda 
        eid = 0xbf

Nov 18 2024 22:06:44.426859482 ereport.fs.zfs.vdev.corrupt_data
        class = "ereport.fs.zfs.vdev.corrupt_data"
        ena = 0x19369942ec400001
        detector = (embedded nvlist)
                version = 0x0
                scheme = "zfs"
                pool = 0x4698d52776b844d5
                vdev = 0xf45599fcc9432cb9
        (end detector)
        pool = "tank"
        pool_guid = 0x4698d52776b844d5
        pool_state = 0x0
        pool_context = 0x2
        pool_failmode = "continue"
        vdev_guid = 0xf45599fcc9432cb9
        vdev_type = "mirror"
        vdev_ashift = 0xc
        vdev_complete_ts = 0x0
        vdev_delta_ts = 0x0
        vdev_read_errors = 0x0
        vdev_write_errors = 0x0
        vdev_cksum_errors = 0x0
        vdev_delays = 0x0
        parent_guid = 0x4698d52776b844d5
        parent_type = "root"
        vdev_spare_paths = 
        vdev_spare_guids = 
        prev_state = 0x7
        time = 0x673c00c4 0x19715bda 
        eid = 0xc0

Nov 18 2024 22:06:44.426859482 ereport.fs.zfs.zpool
        class = "ereport.fs.zfs.zpool"
        ena = 0x19369942ec400001
        detector = (embedded nvlist)
                version = 0x0
                scheme = "zfs"
                pool = 0x4698d52776b844d5
        (end detector)
        pool = "tank"
        pool_guid = 0x4698d52776b844d5
        pool_state = 0x0
        pool_context = 0x2
        pool_failmode = "continue"
        time = 0x673c00c4 0x19715bda 
        eid = 0xc1

root@truenas[/home/admin]# ```

HoneyBadger · November 19, 2024, 5:10pm

Very odd that a mirror3 is showing with devices missing.

What does lsblk -f show, and can you attempt to import by numeric pool ID (5087050144587203797)?

truenasrooks · November 19, 2024, 5:16pm

root@truenas[/home/admin]# lsblk -f
NAME   FSTYPE     FSVER LABEL     UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
sda                                                                                   
├─sda1                                                                                
├─sda2 vfat       FAT32 EFI       44F1-C597                                           
├─sda3 zfs_member 5000  boot-pool 1696277370963779199                                 
└─sda4                                                                                
sdb                                                                                   
└─sdb1 zfs_member 5000  tank      5087050144587203797                                 
sdc                                                                                   
└─sdc1 zfs_member 5000  tank      5087050144587203797                                 
sdd                                                                                   
└─sdd1 zfs_member 5000  ssd       9570678906628884325                                 
sde                                                                                   
└─sde1 zfs_member 5000  ssd       9570678906628884325                                 
sdf                                                                                   
└─sdf1 zfs_member 5000  tank      5087050144587203797                                 
root@truenas[/home/admin]#

root@truenas[/home/admin]# zpool import 5087050144587203797
cannot import ‘tank’: one or more devices is currently unavailable
root@truenas[/home/admin]#

Still same. im not sure whats the issue. SMART Long is running from last night. 80% done on those 3 12T disks.

im going to try removing my GPU and add HBA card and connect and see if it takes ? do you think its worth or it will be same ?

joeschmuck · November 19, 2024, 5:17pm

I’m curious what this message means:

WARNING: can't open objset 54, error 5

Out of curiosity, is the system time set correctly? Did you have a time change due to daylight savings?

Have you tried to import the pool as read-only?

How recently was the upgrade?
Was the system running well and had you powered down the system at least once since the upgrade and it came back online without issue?
If you have a previous boot environment, I’m thinking you make it active, reboot, and see what happens. Of course if you upgraded the ZFS feature set, odds are you cannot roll back which is why no one should update those features unless they need to or at least wait a few months before accepting it.

Lastly, if you enter midclt call disk.query | jq and then search the disk data to match the gptid’s of the three drives listed in the zpool status page, just to ensure something odd like a changed number/character didn’t happen. I just find it odd that the system is telling you that you do not have all the devices.

There is a rash of these things happening and it would be nice to rule out something.

winnielinnie · November 19, 2024, 5:23pm

Did this only occur shortly after you upgraded to Electric Eel?

Is it possible to boot back into Dragonfish (via “Boot Environments”) and attempt to import it via the GUI, normally?

bacon · November 19, 2024, 5:27pm

Might be worth to try to import the pool readonly:

sudo zpool import -o readonly=on -R /mnt tank

Regarding the error:

WARNING: can't open objset 54, error 5

Not much I can find about that error. Occurs during zil_check_log_chain. Error 5 is usually input/output error.

truenasrooks · November 19, 2024, 5:29pm

i had some random issues before upgrade but pool was still attached and no critical issues.

I upgraded to electric eel. thinking it will make things better.

Time is set correctly, i didnt do it but it all synced to current EST without daylight

im going to try revert to old setup. is this the right one to do ?

winnielinnie · November 19, 2024, 5:29pm

Don’t forget for TrueNAS (specifically), to always use the -R /mnt option when importing a pool through the command-line.

winnielinnie · November 19, 2024, 5:30pm

You have a Boot Environment for 24.04.2.3

Hopefully you didn’t do anything that requires Electric Eel (24.10) in order to operate.

truenasrooks · November 19, 2024, 5:31pm

read only not working either.

admin@truenas[~]$ sudo su
[sudo] password for admin:
root@truenas[/home/admin]# sudo zpool import -o readonly=on tank
cannot import ‘tank’: insufficient replicas
Destroy and re-create the pool from
a backup source.
root@truenas[/home/admin]# zpool import
pool: tank
id: 5087050144587203797
state: ONLINE
status: One or more devices were being resilvered.
action: The pool can be imported using its name or numeric identifier.
config:

    tank                                      ONLINE
      mirror-0                                ONLINE
        a9e51b2f-2df8-48ae-9c3e-6303e9256c28  ONLINE
        d08bcfdf-d4fc-4094-8978-7f29368f737f  ONLINE
        a3573b00-d380-4587-806a-8a1a50690002  ONLINE

root@truenas[/home/admin]#
root@truenas[/home/admin]#

EDIT: same error with this command too

sudo zpool import -o readonly=on -R /mnt tank

truenasrooks · November 19, 2024, 5:37pm

where can i cross check the id ?

root@truenas[/home/admin]# midclt call disk.query | jq
[
  {
    "identifier": "{serial_lunid}8CG9NRAE_5000cca26fc4651f",
    "name": "sdc",
    "subsystem": "scsi",
    "number": 2080,
    "serial": "8CG9NRAE",
    "lunid": "5000cca26fc4651f",
    "size": 12000138625024,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "HUH721212ALE601",
    "rotationrate": 7200,
    "type": "HDD",
    "zfs_guid": "9388162094058127461",
    "bus": "ATA",
    "devname": "sdc",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  },
  {
    "identifier": "{serial_lunid}8CJVUUNE_5000cca26fe8619c",
    "name": "sdf",
    "subsystem": "scsi",
    "number": 2128,
    "serial": "8CJVUUNE",
    "lunid": "5000cca26fe8619c",
    "size": 12000138625024,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "HUH721212ALE601",
    "rotationrate": 7200,
    "type": "HDD",
    "zfs_guid": "17972730002245592786",
    "bus": "ATA",
    "devname": "sdf",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  },
  {
    "identifier": "{serial_lunid}2L3329S8HKF7_5000000000000000",
    "name": "sda",
    "subsystem": "scsi",
    "number": 2048,
    "serial": "2L3329S8HKF7",
    "lunid": "5000000000000000",
    "size": 120034123776,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "ADATA_SU655",
    "rotationrate": null,
    "type": "SSD",
    "zfs_guid": null,
    "bus": "ATA",
    "devname": "sda",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  },
  {
    "identifier": "{serial_lunid}MAB446W102869_53a5a27450100212",
    "name": "sdd",
    "subsystem": "scsi",
    "number": 2096,
    "serial": "MAB446W102869",
    "lunid": "53a5a27450100212",
    "size": 240057409536,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "Lexar_240GB_SSD",
    "rotationrate": null,
    "type": "SSD",
    "zfs_guid": "8374691078963971794",
    "bus": "ATA",
    "devname": "sdd",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  },
  {
    "identifier": "{serial}TPBF2312190010103863",
    "name": "sde",
    "subsystem": "scsi",
    "number": 2112,
    "serial": "TPBF2312190010103863",
    "lunid": null,
    "size": 240057409536,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "T-FORCE_240GB",
    "rotationrate": null,
    "type": "SSD",
    "zfs_guid": "336954752255915850",
    "bus": "ATA",
    "devname": "sde",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  },
  {
    "identifier": "{serial_lunid}AAH0NPLH_5000cca278ce6532",
    "name": "sdb",
    "subsystem": "scsi",
    "number": 2064,
    "serial": "AAH0NPLH",
    "lunid": "5000cca278ce6532",
    "size": 12000138625024,
    "description": "",
    "transfermode": "Auto",
    "hddstandby": "ALWAYS ON",
    "advpowermgmt": "DISABLED",
    "togglesmart": true,
    "smartoptions": "",
    "expiretime": null,
    "critical": null,
    "difference": null,
    "informational": null,
    "model": "HUH721212ALE601",
    "rotationrate": 7200,
    "type": "HDD",
    "zfs_guid": "2644609643477440627",
    "bus": "ATA",
    "devname": "sdb",
    "enclosure": null,
    "supports_smart": null,
    "pool": null
  }
]
root@truenas[/home/admin]#

bacon · November 19, 2024, 6:05pm

zpool status lists partition ids, don’t think you’ll find them in disk.query output. You can use sudo blkid where you can match the ids from zpool status with the PARTUUID value.

Because this is a mirror, any single device should be importable. I think what I would try is to unplug two of the drives and try to readonly import the remaining one. Hopefully at least one of the drives has a working pool on it. Make sure to export the pool first in TrueNAS, you don’t want any write operations at this point.

But maybe wait what other people say, I don’t have experience what that level of ZFS corruption.

HoneyBadger · November 19, 2024, 6:22pm

What’s odd is that it’s giving the error of “one or more devices is currently unavailable” but all three are present.

Try importing on a per-disk basis with

zpool import 5087050144587203797 -R /mnt -N -f -o cachefile=/data/zfs/zpool.cache -d /dev/disk/by-partuuid/a9e51b2f-2df8-48ae-9c3e-6303e9256c28 -d /dev/disk/by-partuuid/d08bcfdf-d4fc-4094-8978-7f29368f737f -d /dev/disk/by-partuuid/a3573b00-d380-4587-806a-8a1a50690002

If this doesn’t work, let’s see the output of zdb -ul /dev/sdX for each of them (probably attached as text files each) to see if the labels and uberblocks are intact.

NickF1227 · November 19, 2024, 6:40pm

Really quick. Can you please run zpool list -v