Vdev Offline - Disks with exported pools not accessible, but SMART reports no errors

JoeTheSailor · August 1, 2026, 11:35pm

Greetings all, first time poster here. I have read a number of the posts on this topic, and it is appearing my drives have finally died. But before I buy a new HDDs, create a new pool and restore from backups (very time consuming) , I wanted to make one last call for help. Below are the outputs from all of the shell commands related to the system and vdev issues.

I know this is a LOT of info to digest, but I would greatly appreciate any advice that might save me from building a new pool and restoring ~4Tb of data.

System:

Edition: Community
Version: 25.04.2.6

Storage Disks:

(4) Hitachi_HUS724030ALE641 (3.0Gb) - in RAIDZ1 as Master_Pool

Prime Hardware
MB: Gigabyte GA-970A-D3P
North Bridge: AMD 970
South Bridge: AMD SB950
CPU: AMD FX-8600
RAM: 32Gb
Boot drive: Samsung_SSD_860_EVO_250GB

Backup MB used for troubleshooting if it was a MB issue
MB: ASUS M5A97
North Bridge: AMD 970
South Bridge: AMD SB950
CPU: AMD Phenom™ II X4 965
RAM: 8Gb
Boot drive: Samsung_SSD_860_EVO_250GB

Background on what led to the current situation:

Completed proper shutdown to move MB drives etc. to a new case (for better airflow)
Moved guts to new case
Booted system and it was reported that one of the drives in Master_Pool was Unavailable “Pool Master_Pool state is DEGRADED: One or more devices could not be used because the label is missing or invalid. Sufficient replicas exist for the pool to continue functioning in a degraded state.”
Shutdown and verified that all SATA and pwr cables were properly seated
Booted system and got the same error. I then tried each of the following:
1. Determined drive that was Unavailable (S/N P8G8V87R)
2. Swapped SATA cables and ports (no change, error continued)
3. Swapped MB to an older one I had on hand, and upon boot up, the whole pool was gone and this is where we sit.

Current Status:

Disks still show Green under Disk Health and list Master_Pool (Exported) under pool (see below)

|

Serial	Disk Size	Pool
sdc	S3YHNX0KC03669T	232.89 GiB
sde	P8GW7KNP	2.73 TiB
sdb	P8GYSVSR	2.73 TiB
sdf	P8GZ30YP	2.73 TiB
sdd	P8G8V87R	2.73 TiB

truenas_admin@DISKSTATION2\[\~\]$ sudo zpool import
pool: Master_Pool
id: 3794440546214538116
state: UNAVAIL
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.
config:

Master_Pool                               UNAVAIL  insufficient replicas
  raidz1-0                                UNAVAIL  insufficient replicas
    50edd73c-ba26-4da1-89d1-a890abdbd997  UNAVAIL  invalid label
    825ba380-83ec-4cdd-a9a2-e886e2b2b276  ONLINE
    6eac2201-7f6d-436d-8dc7-cd0db703e581  ONLINE
    6936695650409622532                   UNAVAIL  invalid label


pool: Pool_001
id: 16892498426312978789
state: UNAVAIL
status: The pool was last accessed by another system.
action: The pool cannot be imported due to damaged devices or data.
config:

Pool_001                                UNAVAIL  insufficient replicas
  65f3e111-d0bb-404b-8b81-00af2df6f636  ONLINE
  edbe7f95-c308-4274-a73d-7f5b6034f34d  UNAVAIL
  ca251442-c80d-42d1-800a-6f36a21c9e84  UNAVAIL


truenas_admin@DISKSTATION2\[\~\]$ sudo zpool status -v
\[sudo\] password for truenas_admin:
pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:09 with 0 errors on Tue Jul 28 03:45:11 2026
config:

NAME        STATE     READ WRITE CKSUM
boot-pool   ONLINE       0     0     0
  sdc3      ONLINE       0     0     0


errors: No known data errors
truenas_admin@DISKSTATION2\[\~\]$

truenas_admin@DISKSTATION2\[\~\]$ sudo zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
boot-pool   232G  2.93G   229G        -         -     6%     1%  1.00x    ONLINE  -

truenas_admin@DISKSTATION2\[\~\]$ sudo zfs list
NAME                                                         USED  AVAIL  REFER  MOUNTPOINT
boot-pool                                                   2.93G   222G    96K  none
boot-pool/.system                                           2.12M   222G   120K  legacy
boot-pool/.system/configs-ae32c386e13840b2bf9c0083275e7941    96K   222G    96K  legacy
boot-pool/.system/cores                                       96K  1024M    96K  legacy
boot-pool/.system/netdata-ae32c386e13840b2bf9c0083275e7941  1.42M   222G  1.42M  legacy
boot-pool/.system/nfs                                        104K   222G   104K  legacy
boot-pool/.system/samba4                                     304K   222G   184K  legacy
boot-pool/ROOT                                              2.86G   222G    96K  none
boot-pool/ROOT/25.04.2.6                                    2.86G   222G   176M  legacy
boot-pool/ROOT/25.04.2.6/audit                              20.2M   222G  20.2M  /audit
boot-pool/ROOT/25.04.2.6/conf                               7.15M   222G  7.15M  /conf
boot-pool/ROOT/25.04.2.6/data                                308K   222G   308K  /data
boot-pool/ROOT/25.04.2.6/etc                                7.72M   222G  6.57M  /etc
boot-pool/ROOT/25.04.2.6/home                                184K   222G   184K  /home
boot-pool/ROOT/25.04.2.6/mnt                                 104K   222G   104K  /mnt
boot-pool/ROOT/25.04.2.6/opt                                  96K   222G    96K  /opt
boot-pool/ROOT/25.04.2.6/root                                152K   222G   152K  /root
boot-pool/ROOT/25.04.2.6/usr                                2.56G   222G  2.56G  /usr
boot-pool/ROOT/25.04.2.6/var                                95.7M   222G  5.16M  /var
boot-pool/ROOT/25.04.2.6/var/ca-certificates                  96K   222G    96K  /var/local/ca-certificates
boot-pool/ROOT/25.04.2.6/var/lib                            28.7M   222G  28.2M  /var/lib
boot-pool/ROOT/25.04.2.6/var/lib/incus                        96K   222G    96K  /var/lib/incus
boot-pool/ROOT/25.04.2.6/var/log                            60.7M   222G  11.4M  /var/log
boot-pool/ROOT/25.04.2.6/var/log/journal                    49.3M   222G  49.3M  /var/log/journal
boot-pool/grub                                              8.43M   222G  8.43M  legacy

JoeTheSailor · August 1, 2026, 11:46pm

Output from sudo smartctl -x for first two storage drives.
++++++++++++++++++++++++++++++++++++++++++++++

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GYSVSR
LU WWN Device Id: 5 000cca 22ccd8857
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Aug  1 18:09:55 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    85
  3 Spin_Up_Time            POS---   129   129   024    -    494 (Average 474)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5541
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   124   124   020    -    33
  9 Power_On_Hours          -O--C-   090   090   000    -    71058
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    679
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37713
193 Load_Cycle_Count        -O--C-   069   069   000    -    37713
194 Temperature_Celsius     -O----   171   171   000    -    35 (Min/Max 18/48)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      1949         -
# 2  Short offline       Completed without error       00%      1928         -
# 3  Short offline       Completed without error       00%      1904         -
# 4  Short offline       Completed without error       00%      1880         -
# 5  Short offline       Completed without error       00%      1856         -
# 6  Short offline       Completed without error       00%      1832         -
# 7  Short offline       Completed without error       00%      1808         -
# 8  Short offline       Completed without error       00%      1784         -
# 9  Short offline       Completed without error       00%      1760         -
#10  Short offline       Completed without error       00%      1736         -
#11  Short offline       Completed without error       00%      1712         -
#12  Short offline       Completed without error       00%      1688         -
#13  Short offline       Completed without error       00%      1664         -
#14  Short offline       Completed without error       00%      1640         -
#15  Short offline       Completed without error       00%      1616         -
#16  Short offline       Completed without error       00%      1592         -
#17  Short offline       Completed without error       00%      1568         -
#18  Short offline       Completed without error       00%      1545         -
#19  Short offline       Completed without error       00%      1520         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    35 Celsius
Power Cycle Min/Max Temperature:     35/36 Celsius
Lifetime    Min/Max Temperature:     18/48 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (2)

Index    Estimated Time   Temperature Celsius
   3    2026-08-01 16:02    35  ****************
 ...    ..(  3 skipped).    ..  ****************
   7    2026-08-01 16:06    35  ****************
   8    2026-08-01 16:07    34  ***************
   9    2026-08-01 16:08    35  ****************
 ...    ..(  5 skipped).    ..  ****************
  15    2026-08-01 16:14    35  ****************
  16    2026-08-01 16:15    34  ***************
  17    2026-08-01 16:16    34  ***************
  18    2026-08-01 16:17    34  ***************
  19    2026-08-01 16:18    35  ****************
  20    2026-08-01 16:19    35  ****************
  21    2026-08-01 16:20     ?  -
  22    2026-08-01 16:21    35  ****************
 ...    ..(  2 skipped).    ..  ****************
  25    2026-08-01 16:24    35  ****************
  26    2026-08-01 16:25    34  ***************
  27    2026-08-01 16:26    34  ***************
  28    2026-08-01 16:27    34  ***************
  29    2026-08-01 16:28    35  ****************
 ...    ..(  5 skipped).    ..  ****************
  35    2026-08-01 16:34    35  ****************
  36    2026-08-01 16:35     ?  -
  37    2026-08-01 16:36    34  ***************
  38    2026-08-01 16:37    35  ****************
 ...    ..( 14 skipped).    ..  ****************
  53    2026-08-01 16:52    35  ****************
  54    2026-08-01 16:53     ?  -
  55    2026-08-01 16:54    34  ***************
  56    2026-08-01 16:55    34  ***************
  57    2026-08-01 16:56    35  ****************
 ...    ..(  3 skipped).    ..  ****************
  61    2026-08-01 17:00    35  ****************
  62    2026-08-01 17:01     ?  -
  63    2026-08-01 17:02    34  ***************
 ...    ..(  2 skipped).    ..  ***************
  66    2026-08-01 17:05    34  ***************
  67    2026-08-01 17:06     ?  -
  68    2026-08-01 17:07    33  **************
  69    2026-08-01 17:08    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  74    2026-08-01 17:13    34  ***************
  75    2026-08-01 17:14     ?  -
  76    2026-08-01 17:15    30  ***********
  77    2026-08-01 17:16    31  ************
  78    2026-08-01 17:17    31  ************
  79    2026-08-01 17:18    32  *************
 ...    ..(  2 skipped).    ..  *************
  82    2026-08-01 17:21    32  *************
  83    2026-08-01 17:22    33  **************
 ...    ..(  3 skipped).    ..  **************
  87    2026-08-01 17:26    33  **************
  88    2026-08-01 17:27    34  ***************
 ...    ..(  7 skipped).    ..  ***************
  96    2026-08-01 17:35    34  ***************
  97    2026-08-01 17:36     ?  -
  98    2026-08-01 17:37    34  ***************
  99    2026-08-01 17:38    34  ***************
 100    2026-08-01 17:39    34  ***************
 101    2026-08-01 17:40     ?  -
 102    2026-08-01 17:41    35  ****************
 103    2026-08-01 17:42    35  ****************
 104    2026-08-01 17:43    35  ****************
 105    2026-08-01 17:44     ?  -
 106    2026-08-01 17:45    35  ****************
 ...    ..(  6 skipped).    ..  ****************
 113    2026-08-01 17:52    35  ****************
 114    2026-08-01 17:53     ?  -
 115    2026-08-01 17:54    35  ****************
 116    2026-08-01 17:55    36  *****************
 117    2026-08-01 17:56    35  ****************
 ...    ..(  5 skipped).    ..  ****************
 123    2026-08-01 18:02    35  ****************
 124    2026-08-01 18:03    36  *****************
 125    2026-08-01 18:04    35  ****************
 ...    ..(  4 skipped).    ..  ****************
   2    2026-08-01 18:09    35  ****************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             679  ---  Lifetime Power-On Resets
0x01  0x018  6    612153774079  ---  Logical Sectors Written
0x01  0x020  6      1824039063  ---  Number of Write Commands
0x01  0x028  6   1150777068472  ---  Logical Sectors Read
0x01  0x030  6      2365983250  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68515  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68512  ---  Head Flying Hours
0x03  0x018  4           37713  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4              21  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              36  ---  Current Temperature
0x05  0x010  1              34  N--  Average Short Term Temperature
0x05  0x018  1              35  N--  Average Long Term Temperature
0x05  0x020  1              48  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              44  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              42  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2191743  ---  Number of Hardware Resets
0x06  0x010  4         2188699  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke

=== START OF INFORMATION SECTION ===
Model Family:     Samsung based SSDs
Device Model:     Samsung SSD 860 EVO 250GB
Serial Number:    S3YHNX0KC03669T
LU WWN Device Id: 5 002538 e40b681c1
Firmware Version: RVT02B6Q
User Capacity:    250,059,350,016 bytes [250 GB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
TRIM Command:     Available, deterministic, zeroed
Device is:        In smartctl database 7.3/6204
ATA Version is:   ACS-4 T13/BSR INCITS 529 revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Aug  1 18:12:32 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x53) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        No Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (  85) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  5 Reallocated_Sector_Ct   PO--CK   100   100   010    -    0
  9 Power_On_Hours          -O--CK   091   091   000    -    42588
 12 Power_Cycle_Count       -O--CK   099   099   000    -    952
177 Wear_Leveling_Count     PO--C-   099   099   000    -    12
179 Used_Rsvd_Blk_Cnt_Tot   PO--C-   100   100   010    -    0
181 Program_Fail_Cnt_Total  -O--CK   100   100   010    -    0
182 Erase_Fail_Count_Total  -O--CK   100   100   010    -    0
183 Runtime_Bad_Block       PO--C-   100   100   010    -    0
187 Uncorrectable_Error_Cnt -O--CK   100   100   000    -    0
190 Airflow_Temperature_Cel -O--CK   070   052   000    -    30
195 ECC_Error_Rate          -O-RC-   200   200   000    -    0
199 CRC_Error_Count         -OSRCK   099   099   000    -    62
235 POR_Recovery_Count      -O--C-   099   099   000    -    205
241 Total_LBAs_Written      -O--CK   099   099   000    -    3509978242
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL,SL  R/O      8  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa1           SL  VS      16  Device vendor specific log
0xa5           SL  VS      16  Device vendor specific log
0xce-0xcf      SL  VS      16  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     38026         -
# 2  Short offline       Completed without error       00%     18002         -
# 3  Short offline       Completed without error       00%     15543         -
# 4  Short offline       Aborted by host               20%      5537         -
# 5  Short offline       Completed without error       00%      5537         -
# 6  Short offline       Completed without error       00%      5253         -
# 7  Short offline       Completed without error       00%      3606         -
# 8  Short offline       Completed without error       00%      3414         -
# 9  Short offline       Completed without error       00%      2721         -
#10  Short offline       Completed without error       00%      1734         -
#11  Short offline       Completed without error       00%      1292         -
#12  Short offline       Completed without error       00%      1170         -
#13  Short offline       Completed without error       00%       995         -
#14  Short offline       Completed without error       00%       834         -
#15  Short offline       Completed without error       00%       409         -
#16  Short offline       Completed without error       00%       228         -
#17  Short offline       Completed without error       00%       100         -
#18  Short offline       Completed without error       00%        92         -
#19  Short offline       Completed without error       00%         0         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    30 Celsius
Power Cycle Min/Max Temperature:     30/40 Celsius
Lifetime    Min/Max Temperature:     20/44 Celsius
Specified Max Operating Temperature:    70 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        10 minutes
Min/Max recommended Temperature:      0/70 Celsius
Min/Max Temperature Limit:            0/70 Celsius
Temperature History Size (Index):    128 (126)

Index    Estimated Time   Temperature Celsius
 127    2026-07-31 21:00    31  ************
 ...    ..( 60 skipped).    ..  ************
  60    2026-08-01 07:10    31  ************
  61    2026-08-01 07:20    30  ***********
 ...    ..(  6 skipped).    ..  ***********
  68    2026-08-01 08:30    30  ***********
  69    2026-08-01 08:40    31  ************
  70    2026-08-01 08:50    30  ***********
  71    2026-08-01 09:00    30  ***********
  72    2026-08-01 09:10    31  ************
  73    2026-08-01 09:20    31  ************
  74    2026-08-01 09:30    30  ***********
 ...    ..(  2 skipped).    ..  ***********
  77    2026-08-01 10:00    30  ***********
  78    2026-08-01 10:10    31  ************
  79    2026-08-01 10:20    31  ************
  80    2026-08-01 10:30     ?  -
  81    2026-08-01 10:40    28  *********
  82    2026-08-01 10:50    29  **********
  83    2026-08-01 11:00    30  ***********
 ...    ..( 14 skipped).    ..  ***********
  98    2026-08-01 13:30    30  ***********
  99    2026-08-01 13:40     ?  -
 100    2026-08-01 13:50    31  ************
 101    2026-08-01 14:00    31  ************
 102    2026-08-01 14:10    30  ***********
 ...    ..(  6 skipped).    ..  ***********
 109    2026-08-01 15:20    30  ***********
 110    2026-08-01 15:30     ?  -
 111    2026-08-01 15:40    31  ************
 112    2026-08-01 15:50     ?  -
 113    2026-08-01 16:00    31  ************
 114    2026-08-01 16:10     ?  -
 ...    ..(  3 skipped).    ..  -
 118    2026-08-01 16:50     ?  -
 119    2026-08-01 17:00    29  **********
 120    2026-08-01 17:10    30  ***********
 121    2026-08-01 17:20     ?  -
 ...    ..(  3 skipped).    ..  -
 125    2026-08-01 18:00     ?  -
 126    2026-08-01 18:10    30  ***********

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4             952  ---  Lifetime Power-On Resets
0x01  0x010  4           42588  ---  Power-on Hours
0x01  0x018  6      3509978242  ---  Logical Sectors Written
0x01  0x020  6       173721155  ---  Number of Write Commands
0x01  0x028  6      4828777834  ---  Logical Sectors Read
0x01  0x030  6        34696537  ---  Number of Read Commands
0x01  0x038  6         1384000  ---  Date and Time TimeStamp
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               4  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              30  ---  Current Temperature
0x05  0x020  1              44  ---  Highest Temperature
0x05  0x028  1              20  ---  Lowest Temperature
0x05  0x058  1              70  ---  Specified Maximum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4          659475  ---  Number of Hardware Resets
0x06  0x010  4               0  ---  Number of ASR Events
0x06  0x018  4              62  ---  Number of Interface CRC Errors
0x07  =====  =               =  ===  == Solid State Device Statistics (rev 1) ==
0x07  0x008  1               0  N--  Percentage Used Endurance Indicator
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            5  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS
0x000f  2            0  R_ERR response for host-to-device data FIS, CRC
0x0010  2            0  R_ERR response for host-to-device data FIS, non-CRC
0x0012  2            0  R_ERR response for host-to-device non-data FIS, CRC
0x0013  2            0  R_ERR response for host-to-device non-data FIS, non-CRC

JoeTheSailor · August 1, 2026, 11:49pm

Output from sudo smartctl -x for last two storage drives.
++++++++++++++++++++++++++++++++++++++++++++++

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdd
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, 

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8G8V87R
LU WWN Device Id: 5 000cca 22cc40591
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Aug  1 18:13:13 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    85
  3 Spin_Up_Time            POS---   130   130   024    -    468 (Average 490)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5541
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    70875
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    684
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37820
193 Load_Cycle_Count        -O--C-   069   069   000    -    37820
194 Temperature_Celsius     -O----   181   181   000    -    33 (Min/Max 18/52)
196 Reallocated_Event_Count -O--CK   100   100   000    -    2
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      5338         -
# 2  Short offline       Completed without error       00%      5337         -
# 3  Short offline       Completed without error       00%      1766         -
# 4  Short offline       Completed without error       00%      1745         -
# 5  Short offline       Completed without error       00%      1721         -
# 6  Short offline       Completed without error       00%      1696         -
# 7  Short offline       Completed without error       00%      1672         -
# 8  Short offline       Completed without error       00%      1648         -
# 9  Short offline       Completed without error       00%      1624         -
#10  Short offline       Completed without error       00%      1600         -
#11  Short offline       Completed without error       00%      1576         -
#12  Short offline       Completed without error       00%      1552         -
#13  Short offline       Completed without error       00%      1528         -
#14  Short offline       Completed without error       00%      1504         -
#15  Short offline       Completed without error       00%      1480         -
#16  Short offline       Completed without error       00%      1456         -
#17  Short offline       Completed without error       00%      1432         -
#18  Short offline       Completed without error       00%      1408         -
#19  Short offline       Completed without error       00%      1384         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    33 Celsius
Power Cycle Min/Max Temperature:     33/33 Celsius
Lifetime    Min/Max Temperature:     18/52 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (93)

Index    Estimated Time   Temperature Celsius
  94    2026-08-01 16:06    32  *************
 ...    ..( 15 skipped).    ..  *************
 110    2026-08-01 16:22    32  *************
 111    2026-08-01 16:23    31  ************
 112    2026-08-01 16:24    32  *************
 113    2026-08-01 16:25    32  *************
 114    2026-08-01 16:26    32  *************
 115    2026-08-01 16:27    31  ************
 116    2026-08-01 16:28    32  *************
 117    2026-08-01 16:29     ?  -
 118    2026-08-01 16:30    32  *************
 ...    ..(  2 skipped).    ..  *************
 121    2026-08-01 16:33    32  *************
 122    2026-08-01 16:34    31  ************
 123    2026-08-01 16:35    32  *************
 ...    ..(  7 skipped).    ..  *************
   3    2026-08-01 16:43    32  *************
   4    2026-08-01 16:44     ?  -
   5    2026-08-01 16:45    31  ************
   6    2026-08-01 16:46    32  *************
 ...    ..( 14 skipped).    ..  *************
  21    2026-08-01 17:01    32  *************
  22    2026-08-01 17:02     ?  -
  23    2026-08-01 17:03    32  *************
 ...    ..(  5 skipped).    ..  *************
  29    2026-08-01 17:09    32  *************
  30    2026-08-01 17:10     ?  -
  31    2026-08-01 17:11    31  ************
  32    2026-08-01 17:12    32  *************
  33    2026-08-01 17:13    32  *************
  34    2026-08-01 17:14    32  *************
  35    2026-08-01 17:15     ?  -
  36    2026-08-01 17:16    31  ************
  37    2026-08-01 17:17    32  *************
 ...    ..(  4 skipped).    ..  *************
  42    2026-08-01 17:22    32  *************
  43    2026-08-01 17:23     ?  -
  44    2026-08-01 17:24    29  **********
  45    2026-08-01 17:25    30  ***********
  46    2026-08-01 17:26    30  ***********
  47    2026-08-01 17:27    30  ***********
  48    2026-08-01 17:28    31  ************
 ...    ..(  2 skipped).    ..  ************
  51    2026-08-01 17:31    31  ************
  52    2026-08-01 17:32    32  *************
 ...    ..(  5 skipped).    ..  *************
  58    2026-08-01 17:38    32  *************
  59    2026-08-01 17:39    33  **************
 ...    ..(  4 skipped).    ..  **************
  64    2026-08-01 17:44    33  **************
  65    2026-08-01 17:45     ?  -
  66    2026-08-01 17:46    33  **************
  67    2026-08-01 17:47    33  **************
  68    2026-08-01 17:48    33  **************
  69    2026-08-01 17:49     ?  -
  70    2026-08-01 17:50    33  **************
  71    2026-08-01 17:51    33  **************
  72    2026-08-01 17:52    33  **************
  73    2026-08-01 17:53     ?  -
  74    2026-08-01 17:54    33  **************
 ...    ..( 18 skipped).    ..  **************
  93    2026-08-01 18:13    33  **************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             684  ---  Lifetime Power-On Resets
0x01  0x018  6    571419623359  ---  Logical Sectors Written
0x01  0x020  6      1798009835  ---  Number of Write Commands
0x01  0x028  6   1083342650334  ---  Logical Sectors Read
0x01  0x030  6      2270410937  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68381  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68378  ---  Head Flying Hours
0x03  0x018  4           37820  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4            2310  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4              23  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              34  ---  Current Temperature
0x05  0x010  1              40  N--  Average Short Term Temperature
0x05  0x018  1              44  N--  Average Long Term Temperature
0x05  0x020  1              52  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              48  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              45  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2193091  ---  Number of Hardware Resets
0x06  0x010  4         2189789  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            6  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sde
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke,

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GW7KNP
LU WWN Device Id: 5 000cca 22ccc626f
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Aug  1 18:14:03 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   136   136   054    -    83
  3 Spin_Up_Time            POS---   129   129   024    -    496 (Average 469)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5535
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    71195
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    673
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37662
193 Load_Cycle_Count        -O--C-   069   069   000    -    37662
194 Temperature_Celsius     -O----   171   171   000    -    35 (Min/Max 18/50)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      2086         -
# 2  Short offline       Completed without error       00%      2064         -
# 3  Short offline       Completed without error       00%      2040         -
# 4  Short offline       Completed without error       00%      2016         -
# 5  Short offline       Completed without error       00%      1992         -
# 6  Short offline       Completed without error       00%      1968         -
# 7  Short offline       Completed without error       00%      1944         -
# 8  Short offline       Completed without error       00%      1920         -
# 9  Short offline       Completed without error       00%      1896         -
#10  Short offline       Completed without error       00%      1872         -
#11  Short offline       Completed without error       00%      1848         -
#12  Short offline       Completed without error       00%      1824         -
#13  Short offline       Completed without error       00%      1800         -
#14  Short offline       Completed without error       00%      1776         -
#15  Short offline       Completed without error       00%      1752         -
#16  Short offline       Completed without error       00%      1728         -
#17  Short offline       Completed without error       00%      1704         -
#18  Short offline       Completed without error       00%      1682         -
#19  Short offline       Completed without error       00%      1656         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    34 Celsius
Power Cycle Min/Max Temperature:     34/35 Celsius
Lifetime    Min/Max Temperature:     18/50 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (12)

Index    Estimated Time   Temperature Celsius
  13    2026-08-01 16:07    34  ***************
 ...    ..( 11 skipped).    ..  ***************
  25    2026-08-01 16:19    34  ***************
  26    2026-08-01 16:20     ?  -
  27    2026-08-01 16:21    34  ***************
 ...    ..(  5 skipped).    ..  ***************
  33    2026-08-01 16:27    34  ***************
  34    2026-08-01 16:28    35  ****************
  35    2026-08-01 16:29    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  40    2026-08-01 16:34    34  ***************
  41    2026-08-01 16:35     ?  -
  42    2026-08-01 16:36    33  **************
  43    2026-08-01 16:37    34  ***************
 ...    ..( 14 skipped).    ..  ***************
  58    2026-08-01 16:52    34  ***************
  59    2026-08-01 16:53     ?  -
  60    2026-08-01 16:54    33  **************
  61    2026-08-01 16:55    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  66    2026-08-01 17:00    34  ***************
  67    2026-08-01 17:01     ?  -
  68    2026-08-01 17:02    33  **************
 ...    ..(  2 skipped).    ..  **************
  71    2026-08-01 17:05    33  **************
  72    2026-08-01 17:06     ?  -
  73    2026-08-01 17:07    32  *************
  74    2026-08-01 17:08    33  **************
 ...    ..(  4 skipped).    ..  **************
  79    2026-08-01 17:13    33  **************
  80    2026-08-01 17:14     ?  -
  81    2026-08-01 17:15    29  **********
  82    2026-08-01 17:16    30  ***********
  83    2026-08-01 17:17    30  ***********
  84    2026-08-01 17:18    31  ************
 ...    ..(  2 skipped).    ..  ************
  87    2026-08-01 17:21    31  ************
  88    2026-08-01 17:22    32  *************
 ...    ..(  3 skipped).    ..  *************
  92    2026-08-01 17:26    32  *************
  93    2026-08-01 17:27    33  **************
 ...    ..(  5 skipped).    ..  **************
  99    2026-08-01 17:33    33  **************
 100    2026-08-01 17:34    34  ***************
 101    2026-08-01 17:35    34  ***************
 102    2026-08-01 17:36     ?  -
 103    2026-08-01 17:37    33  **************
 104    2026-08-01 17:38    33  **************
 105    2026-08-01 17:39    33  **************
 106    2026-08-01 17:40     ?  -
 107    2026-08-01 17:41    34  ***************
 108    2026-08-01 17:42    34  ***************
 109    2026-08-01 17:43    34  ***************
 110    2026-08-01 17:44     ?  -
 111    2026-08-01 17:45    34  ***************
 ...    ..(  6 skipped).    ..  ***************
 118    2026-08-01 17:52    34  ***************
 119    2026-08-01 17:53     ?  -
 120    2026-08-01 17:54    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 124    2026-08-01 17:58    34  ***************
 125    2026-08-01 17:59    35  ****************
 126    2026-08-01 18:00    35  ****************
 127    2026-08-01 18:01    34  ***************
   0    2026-08-01 18:02    34  ***************
   1    2026-08-01 18:03    35  ****************
   2    2026-08-01 18:04    34  ***************
   3    2026-08-01 18:05    34  ***************
   4    2026-08-01 18:06    34  ***************
   5    2026-08-01 18:07    35  ****************
   6    2026-08-01 18:08    35  ****************
   7    2026-08-01 18:09    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  12    2026-08-01 18:14    34  ***************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             673  ---  Lifetime Power-On Resets
0x01  0x018  6    574692672775  ---  Logical Sectors Written
0x01  0x020  6      1852886174  ---  Number of Write Commands
0x01  0x028  6   1227144046897  ---  Logical Sectors Read
0x01  0x030  6      2546406093  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68696  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68693  ---  Head Flying Hours
0x03  0x018  4           37662  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4             261  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              35  ---  Current Temperature
0x05  0x010  1              32  N--  Average Short Term Temperature
0x05  0x018  1              32  N--  Average Long Term Temperature
0x05  0x020  1              50  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              45  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              42  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2192343  ---  Number of Hardware Resets
0x06  0x010  4         2189149  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdf
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke,
=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GZ30YP
LU WWN Device Id: 5 000cca 22ccdae82
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Aug  1 18:15:38 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    84
  3 Spin_Up_Time            POS---   132   132   024    -    487 (Average 456)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5524
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    71196
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    667
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37651
193 Load_Cycle_Count        -O--C-   069   069   000    -    37651
194 Temperature_Celsius     -O----   166   166   000    -    36 (Min/Max 18/55)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      2087         -
# 2  Short offline       Completed without error       00%      2065         -
# 3  Short offline       Completed without error       00%      2041         -
# 4  Short offline       Completed without error       00%      2017         -
# 5  Short offline       Completed without error       00%      1993         -
# 6  Short offline       Completed without error       00%      1969         -
# 7  Short offline       Completed without error       00%      1945         -
# 8  Short offline       Completed without error       00%      1921         -
# 9  Short offline       Completed without error       00%      1897         -
#10  Short offline       Completed without error       00%      1873         -
#11  Short offline       Completed without error       00%      1849         -
#12  Short offline       Completed without error       00%      1825         -
#13  Short offline       Completed without error       00%      1801         -
#14  Short offline       Completed without error       00%      1777         -
#15  Short offline       Completed without error       00%      1753         -
#16  Short offline       Completed without error       00%      1729         -
#17  Short offline       Completed without error       00%      1705         -
#18  Short offline       Completed without error       00%      1682         -
#19  Short offline       Completed without error       00%      1657         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    36 Celsius
Power Cycle Min/Max Temperature:     36/36 Celsius
Lifetime    Min/Max Temperature:     18/55 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (2)

Index    Estimated Time   Temperature Celsius
   3    2026-08-01 16:08    34  ***************
 ...    ..( 10 skipped).    ..  ***************
  14    2026-08-01 16:19    34  ***************
  15    2026-08-01 16:20     ?  -
  16    2026-08-01 16:21    35  ****************
  17    2026-08-01 16:22    35  ****************
  18    2026-08-01 16:23    34  ***************
  19    2026-08-01 16:24    35  ****************
  20    2026-08-01 16:25    34  ***************
  21    2026-08-01 16:26    34  ***************
  22    2026-08-01 16:27    34  ***************
  23    2026-08-01 16:28    35  ****************
 ...    ..(  5 skipped).    ..  ****************
  29    2026-08-01 16:34    35  ****************
  30    2026-08-01 16:35     ?  -
  31    2026-08-01 16:36    34  ***************
  32    2026-08-01 16:37    34  ***************
  33    2026-08-01 16:38    35  ****************
  34    2026-08-01 16:39    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  38    2026-08-01 16:43    34  ***************
  39    2026-08-01 16:44    35  ****************
  40    2026-08-01 16:45    34  ***************
  41    2026-08-01 16:46    35  ****************
 ...    ..(  5 skipped).    ..  ****************
  47    2026-08-01 16:52    35  ****************
  48    2026-08-01 16:53     ?  -
  49    2026-08-01 16:54    34  ***************
  50    2026-08-01 16:55    34  ***************
  51    2026-08-01 16:56    35  ****************
 ...    ..(  3 skipped).    ..  ****************
  55    2026-08-01 17:00    35  ****************
  56    2026-08-01 17:01     ?  -
  57    2026-08-01 17:02    34  ***************
 ...    ..(  2 skipped).    ..  ***************
  60    2026-08-01 17:05    34  ***************
  61    2026-08-01 17:06     ?  -
  62    2026-08-01 17:07    33  **************
  63    2026-08-01 17:08    33  **************
  64    2026-08-01 17:09    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  68    2026-08-01 17:13    34  ***************
  69    2026-08-01 17:14     ?  -
  70    2026-08-01 17:15    30  ***********
  71    2026-08-01 17:16    31  ************
  72    2026-08-01 17:17    31  ************
  73    2026-08-01 17:18    32  *************
 ...    ..(  2 skipped).    ..  *************
  76    2026-08-01 17:21    32  *************
  77    2026-08-01 17:22    33  **************
 ...    ..(  2 skipped).    ..  **************
  80    2026-08-01 17:25    33  **************
  81    2026-08-01 17:26    34  ***************
 ...    ..(  6 skipped).    ..  ***************
  88    2026-08-01 17:33    34  ***************
  89    2026-08-01 17:34    35  ****************
  90    2026-08-01 17:35    35  ****************
  91    2026-08-01 17:36     ?  -
  92    2026-08-01 17:37    34  ***************
  93    2026-08-01 17:38    34  ***************
  94    2026-08-01 17:39    35  ****************
  95    2026-08-01 17:40     ?  -
  96    2026-08-01 17:41    35  ****************
  97    2026-08-01 17:42    35  ****************
  98    2026-08-01 17:43    35  ****************
  99    2026-08-01 17:44     ?  -
 100    2026-08-01 17:45    35  ****************
 101    2026-08-01 17:46    35  ****************
 102    2026-08-01 17:47    36  *****************
 ...    ..(  4 skipped).    ..  *****************
 107    2026-08-01 17:52    36  *****************
 108    2026-08-01 17:53     ?  -
 109    2026-08-01 17:54    36  *****************
 ...    ..( 20 skipped).    ..  *****************
   2    2026-08-01 18:15    36  *****************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             667  ---  Lifetime Power-On Resets
0x01  0x018  6    563188992727  ---  Logical Sectors Written
0x01  0x020  6      1927414405  ---  Number of Write Commands
0x01  0x028  6   1260699092093  ---  Logical Sectors Read
0x01  0x030  6      2684172444  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68684  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68682  ---  Head Flying Hours
0x03  0x018  4           37651  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4             566  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              36  ---  Current Temperature
0x05  0x010  1              41  N--  Average Short Term Temperature
0x05  0x018  1              44  N--  Average Long Term Temperature
0x05  0x020  1              55  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              52  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              50  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2191061  ---  Number of Hardware Resets
0x06  0x010  4         2188403  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

truenas_admin@DISKSTATION2[~]$ sudo lsblk -bo NAME,LABEL,MAJ:MIN,TRAN,ROTA,ZONED,VENDOR,MODEL,SERIAL,PARTUUID,START,SIZE,PARTTYPENAME
NAME LABEL MAJ:MIN TRAN   ROTA ZONED VENDOR MODEL SERIAL PARTUUID                               START          SIZE PARTTYPENAME
sda          8:0   sata      1 none  ATA    WDC W WD-WMA                                               500107862016 
└─sda1
     Pool_001
             8:1             1 none                      65f3e111-d0bb-404b-8b81-00af2df6f636    2048  497960353792 Solaris /usr & Apple ZFS
sdb          8:16  sata      1 none  ATA    Hitac P8GYSV                                              3000592982016 
└─sdb1
     Master_Pool
             8:17            1 none                      825ba380-83ec-4cdd-a9a2-e886e2b2b276    2048 2998445015040 Solaris /usr & Apple ZFS
sdc          8:32  sata      0 none  ATA    Samsu S3YHNX                                               250059350016 
├─sdc1
│            8:33            0 none                      17fd9e79-960f-4442-b8d6-8ed14088bd43    4096       1048576 BIOS boot
├─sdc2
│    EFI     8:34            0 none                      54120ac9-45ae-4dec-bc4a-ec1caf69347a    6144     536870912 EFI System
└─sdc3
     boot-pool
             8:35            0 none                      9c9b7456-78c7-4f19-a87e-e8f8ce26a168 1054720  249519316480 Solaris /usr & Apple ZFS
sdd          8:48  sata      1 none  ATA    Hitac P8G8V8                                              3000592982016 
└─sdd1
             8:49            1 none                      d82b35fe-ad3e-49aa-a21b-4fcaaa3d132e    2048 2998445015040 Solaris /usr & Apple ZFS
sde          8:64  sata      1 none  ATA    Hitac P8GW7K                                              3000592982016 
└─sde1
     Master_Pool
             8:65            1 none                      6eac2201-7f6d-436d-8dc7-cd0db703e581    2048 2998445015040 Solaris /usr & Apple ZFS
sdf          8:80  sata      1 none  ATA    Hitac P8GZ30                                              3000592982016 
└─sdf1
             8:81            1 none                      50edd73c-ba26-4da1-89d1-a890abdbd997    2048 2998445015040 Solaris /usr & Apple ZFS

truenas_admin@DISKSTATION2[~]$ sudo ZPOOL_SCRIPTS_AS_ROOT=1 zpool status -vLtsc lsblk,serial,smartx,smart~  
  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:09 with 0 errors on Tue Jul 28 03:45:11 2026
config:

        NAME        STATE     READ WRITE CKSUM  SLOW    size  vendor                      model           serial  hours_on  pwr_cyc
        boot-pool   ONLINE       0     0     0     -
          sdc3      ONLINE       0     0     0     0  232.9G     ATA  Samsung SSD 860 EVO 250GB  S3YHNX0KC03669T     42588      952  (untrimmed)

errors: No known data errors

truenas_admin@DISKSTATION2[~]$ sudo lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD9x0/RX980 Host Bridge (rev 02)
00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GFX port 0)
00:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 0)
00:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 3)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller (rev 42)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) (rev 40)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller (rev 40)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge (rev 40)
00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller
00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor HyperTransport Configuration
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Address Map
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Miscellaneous Control
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 10h Processor Link Control
01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] RV730 XT [Radeon HD 4670]
01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] RV710/730 HDMI Audio [Radeon HD 4000 series]
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
03:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller

truenas_admin@DISKSTATION2[~]$ for disk in /dev/sd*; do; sudo zdb -l $disk; done
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Pool_001'
    state: 0
    txg: 869456
    pool_guid: 16892498426312978789
    errata: 0
    hostid: 1883420075
    hostname: 'truenas'
    top_guid: 12286275564434495256
    guid: 12286275564434495256
    vdev_children: 3
    vdev_tree:
        type: 'disk'
        id: 0
        guid: 12286275564434495256
        path: '/dev/disk/by-partuuid/65f3e111-d0bb-404b-8b81-00af2df6f636'
        whole_disk: 0
        metaslab_array: 134
        metaslab_shift: 32
        ashift: 12
        asize: 497955635200
        is_log: 0
        DTL: 10490
        create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Master_Pool'
    state: 0
    txg: 2510975
    pool_guid: 3794440546214538116
    errata: 0
    hostid: 1489919046
    hostname: 'DISKSTATION2'
    top_guid: 11261797279433721529
    guid: 5328913318255481285
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11261797279433721529
        nparity: 1
        metaslab_array: 65
        metaslab_shift: 34
        ashift: 12
        asize: 11993761185792
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 3103104782968973553
            path: '/dev/disk/by-partuuid/50edd73c-ba26-4da1-89d1-a890abdbd997'
            whole_disk: 0
            DTL: 3150
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 5328913318255481285
            path: '/dev/disk/by-partuuid/825ba380-83ec-4cdd-a9a2-e886e2b2b276'
            whole_disk: 0
            DTL: 3149
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10984462085616704570
            path: '/dev/disk/by-partuuid/6eac2201-7f6d-436d-8dc7-cd0db703e581'
            whole_disk: 0
            DTL: 3148
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 6936695650409622532
            path: '/dev/disk/by-partuuid/d82b35fe-ad3e-49aa-a21b-4fcaaa3d132e'
            whole_disk: 0
            not_present: 1
            DTL: 3147
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 
failed to unpack label 0
failed to unpack label 1
------------------------------------
LABEL 2 (Bad label cksum)
------------------------------------
    version: 5000
    name: 'boot-pool'
    state: 0
    txg: 2512335
    pool_guid: 3840142718350461473
    errata: 0
    compatibility: 'grub2'
    hostname: '(none)'
    top_guid: 2103643139150370034
    guid: 2103643139150370034
    vdev_children: 1
    vdev_tree:
        type: 'disk'
        id: 0
        guid: 2103643139150370034
        path: '/dev/sdc3'
        whole_disk: 0
        metaslab_array: 128
        metaslab_shift: 31
        ashift: 12
        asize: 249514426368
        is_log: 0
        DTL: 4457
        create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 2 3 
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'boot-pool'
    state: 0
    txg: 2512335
    pool_guid: 3840142718350461473
    errata: 0
    compatibility: 'grub2'
    hostname: '(none)'
    top_guid: 2103643139150370034
    guid: 2103643139150370034
    vdev_children: 1
    vdev_tree:
        type: 'disk'
        id: 0
        guid: 2103643139150370034
        path: '/dev/sdc3'
        whole_disk: 0
        metaslab_array: 128
        metaslab_shift: 31
        ashift: 12
        asize: 249514426368
        is_log: 0
        DTL: 4457
        create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Master_Pool'
    state: 0
    txg: 2510975
    pool_guid: 3794440546214538116
    errata: 0
    hostid: 1489919046
    hostname: 'DISKSTATION2'
    top_guid: 11261797279433721529
    guid: 10984462085616704570
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11261797279433721529
        nparity: 1
        metaslab_array: 65
        metaslab_shift: 34
        ashift: 12
        asize: 11993761185792
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 3103104782968973553
            path: '/dev/disk/by-partuuid/50edd73c-ba26-4da1-89d1-a890abdbd997'
            whole_disk: 0
            DTL: 3150
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 5328913318255481285
            path: '/dev/disk/by-partuuid/825ba380-83ec-4cdd-a9a2-e886e2b2b276'
            whole_disk: 0
            DTL: 3149
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10984462085616704570
            path: '/dev/disk/by-partuuid/6eac2201-7f6d-436d-8dc7-cd0db703e581'
            whole_disk: 0
            DTL: 3148
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 6936695650409622532
            path: '/dev/disk/by-partuuid/d82b35fe-ad3e-49aa-a21b-4fcaaa3d132e'
            whole_disk: 0
            not_present: 1
            DTL: 3147
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3

truenas_admin@DISKSTATION2[~]$ for disk in /dev/sd?; do; sudo hdparm -W $disk; done

/dev/sda:
 write-caching =  1 (on)

/dev/sdb:
 write-caching =  1 (on)

/dev/sdc:
 write-caching =  1 (on)

/dev/sdd:
 write-caching =  1 (on)

/dev/sde:
 write-caching =  1 (on)

/dev/sdf:
 write-caching =  1 (on)

JoeTheSailor · August 1, 2026, 11:51pm

Alerts

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog” dataset(s) required for starting docker.

2026-08-01 13:09:47 (America/New_York)

DismissGo to App Settings

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/truenas_catalog” dataset(s) required for starting docker.

2026-08-01 16:14:57 (America/New_York)

DismissGo to App Settings

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/app_mounts” dataset(s) required for starting docker.

2026-08-01 16:25:08 (America/New_York)

DismissGo to App Settings

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts” dataset(s) required for starting docker.

2026-08-01 17:45:13 (America/New_York)

DismissGo to App Settings

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/app_configs” dataset(s) required for starting docker.

2026-08-01 17:55:04 (America/New_York)

DismissGo to App Settings

Critical

SMB shares have path-related configuration issues that may impact service stability: Backups: Path does not exist., DS410j: Path does not exist., music: Path does not exist., video: Path does not exist., photos: Path does not exist.

2026-08-01 16:14:55 (America/New_York)

DismissGo to SMB shares

Critical

Pool Master_Pool state is OFFLINE: None

2026-08-01 16:14:56 (America/New_York)

DismissGo to Storage

SmallBarky · August 1, 2026, 11:53pm

You should be posting the results of any commands back to the forum using a Preformatted Text box, per command. (</>) or Ctrl+e on the toolbar.

It makes it more readable and keeps the formatting.

What are the pools? You listed Master_Pool and Pool_001 according to your data but also listed a 4 wide Raid-Z1 VDEV. That should only be a single pool?

JoeTheSailor · August 2, 2026, 6:21pm

@SmallBarky thanks for the quick reply and I will endeavor to do a better job using </> in the future on my command outputs.

The only pool of importance is Master_Pool. Master_Pool is the failed pool and it had been made up a 4 wide Raid-A1 VDEV. Pool_001 is on a spare drive I threw in during testing. It just happened to have an old Pool defined on it.

SmallBarky · August 2, 2026, 6:51pm

I would suggest running the SMART Long tests on your problem drives and posting the results back. The Long tests are more helpful.

sudo smartctl -t long /dev/sdX Just replace the X with the correct letter for the drive you’re testing.
Be aware that the drives can change position upon reboots and keep track of your drives by serial number. SDA may be SDB the next boot.

It may be quicker to do SMART Long tests on the drives, make sure they are good and then just redo the pool and restore the data than to go back and forth trying to fix the issue. I would test the system as a new one and do CPU stress tests and RAM tests like Memtest86. We usually say at least 5 passes of the RAM tests.

@HoneyBadger Seeing if we can easily fix ‘invalid label’ issues. Only worried about ‘Master_Pool’, ‘Pool_1’ is just from a drive that wasn’t wiped from a previous pool.

JoeTheSailor · August 2, 2026, 7:15pm

Thx @SmallBarky . I will run the long tests and post back later. Thanks for the support.

SmallBarky · August 2, 2026, 7:45pm

Try ```sudo smartctl -a /dev/sdd’‘’ I thought it should have posted all the extended information. Really, as long as you are getting passes and not showing signs of errors or pre failure signs, you should be okay for SMART.

I just realized I wasn’t scrolling the Preformatted Text boxes. I got use to your first, few posts before the edits to add them, haha

The results you just posted for the Long tests shows 90% remaining. Take a look at them once the Long tests finish.

JoeTheSailor · August 2, 2026, 8:47pm

I should have read further. I stopped at “SMART overall-health self-assessment test result: PASSED”

Thank you for your patience with me. I appreciate the kindness. Others might have flamed me for now two bonehead moves. I am learning.

JoeTheSailor · August 3, 2026, 2:18pm

Completed Long SMART Test Results

All drives show zero errors for the four parameters that I understand are important. Please help me understand if there are other stats to look at that could indicate a failing drive.

ID 5 Reallocated_Sector_Ct
ID 10 Spin_Retry_Count
ID 197 Current_Pending_Sector
ID 198 Offline_Uncorrectable

Serial Number: P8GZ30YP

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GZ30YP
LU WWN Device Id: 5 000cca 22ccdae82
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Aug  3 09:31:45 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    84
  3 Spin_Up_Time            POS---   132   132   024    -    487 (Average 456)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5526
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    71206
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    669
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37653
193 Load_Cycle_Count        -O--C-   069   069   000    -    37653
194 Temperature_Celsius     -O----   187   187   000    -    32 (Min/Max 18/55)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      5669         -
# 2  Short offline       Completed without error       00%      2087         -
# 3  Short offline       Completed without error       00%      2065         -
# 4  Short offline       Completed without error       00%      2041         -
# 5  Short offline       Completed without error       00%      2017         -
# 6  Short offline       Completed without error       00%      1993         -
# 7  Short offline       Completed without error       00%      1969         -
# 8  Short offline       Completed without error       00%      1945         -
# 9  Short offline       Completed without error       00%      1921         -
#10  Short offline       Completed without error       00%      1897         -
#11  Short offline       Completed without error       00%      1873         -
#12  Short offline       Completed without error       00%      1849         -
#13  Short offline       Completed without error       00%      1825         -
#14  Short offline       Completed without error       00%      1801         -
#15  Short offline       Completed without error       00%      1777         -
#16  Short offline       Completed without error       00%      1753         -
#17  Short offline       Completed without error       00%      1729         -
#18  Short offline       Completed without error       00%      1705         -
#19  Short offline       Completed without error       00%      1682         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    32 Celsius
Power Cycle Min/Max Temperature:     24/32 Celsius
Lifetime    Min/Max Temperature:     18/55 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (112)

Index    Estimated Time   Temperature Celsius
 113    2026-08-03 07:24    37  ******************
 ...    ..( 27 skipped).    ..  ******************
  13    2026-08-03 07:52    37  ******************
  14    2026-08-03 07:53    36  *****************
 ...    ..(  7 skipped).    ..  *****************
  22    2026-08-03 08:01    36  *****************
  23    2026-08-03 08:02    35  ****************
 ...    ..( 70 skipped).    ..  ****************
  94    2026-08-03 09:13    35  ****************
  95    2026-08-03 09:14     ?  -
  96    2026-08-03 09:15    25  ******
  97    2026-08-03 09:16    26  *******
  98    2026-08-03 09:17    27  ********
  99    2026-08-03 09:18    27  ********
 100    2026-08-03 09:19    28  *********
 101    2026-08-03 09:20    28  *********
 102    2026-08-03 09:21    29  **********
 103    2026-08-03 09:22    29  **********
 104    2026-08-03 09:23    30  ***********
 105    2026-08-03 09:24    30  ***********
 106    2026-08-03 09:25    30  ***********
 107    2026-08-03 09:26    31  ************
 108    2026-08-03 09:27    31  ************
 109    2026-08-03 09:28    31  ************
 110    2026-08-03 09:29    32  *************
 111    2026-08-03 09:30    32  *************
 112    2026-08-03 09:31    32  *************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             669  ---  Lifetime Power-On Resets
0x01  0x018  6    563188992727  ---  Logical Sectors Written
0x01  0x020  6      1927414405  ---  Number of Write Commands
0x01  0x028  6   1260699250971  ---  Logical Sectors Read
0x01  0x030  6      2684173608  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68695  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68692  ---  Head Flying Hours
0x03  0x018  4           37653  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4             566  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              33  ---  Current Temperature
0x05  0x010  1              37  N--  Average Short Term Temperature
0x05  0x018  1              44  N--  Average Long Term Temperature
0x05  0x020  1              55  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              52  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              50  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2191077  ---  Number of Hardware Resets
0x06  0x010  4         2188407  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

Serial Number: P8G8V87R (this was the first one to become unavailable)

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8G8V87R
LU WWN Device Id: 5 000cca 22cc40591
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Aug  3 09:31:16 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    85
  3 Spin_Up_Time            POS---   128   128   024    -    504 (Average 468)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5543
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    70885
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    686
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37822
193 Load_Cycle_Count        -O--C-   069   069   000    -    37822
194 Temperature_Celsius     -O----   193   193   000    -    31 (Min/Max 18/52)
196 Reallocated_Event_Count -O--CK   100   100   000    -    2
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      5348         -
# 2  Short offline       Completed without error       00%      5338         -
# 3  Short offline       Completed without error       00%      5337         -
# 4  Short offline       Completed without error       00%      1766         -
# 5  Short offline       Completed without error       00%      1745         -
# 6  Short offline       Completed without error       00%      1721         -
# 7  Short offline       Completed without error       00%      1696         -
# 8  Short offline       Completed without error       00%      1672         -
# 9  Short offline       Completed without error       00%      1648         -
#10  Short offline       Completed without error       00%      1624         -
#11  Short offline       Completed without error       00%      1600         -
#12  Short offline       Completed without error       00%      1576         -
#13  Short offline       Completed without error       00%      1552         -
#14  Short offline       Completed without error       00%      1528         -
#15  Short offline       Completed without error       00%      1504         -
#16  Short offline       Completed without error       00%      1480         -
#17  Short offline       Completed without error       00%      1456         -
#18  Short offline       Completed without error       00%      1432         -
#19  Short offline       Completed without error       00%      1408         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    31 Celsius
Power Cycle Min/Max Temperature:     24/31 Celsius
Lifetime    Min/Max Temperature:     18/52 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (77)

Index    Estimated Time   Temperature Celsius
  78    2026-08-03 07:24    34  ***************
 ...    ..( 31 skipped).    ..  ***************
 110    2026-08-03 07:56    34  ***************
 111    2026-08-03 07:57    33  **************
 ...    ..( 21 skipped).    ..  **************
   5    2026-08-03 08:19    33  **************
   6    2026-08-03 08:20    32  *************
   7    2026-08-03 08:21    33  **************
   8    2026-08-03 08:22    32  *************
   9    2026-08-03 08:23    32  *************
  10    2026-08-03 08:24    32  *************
  11    2026-08-03 08:25    33  **************
  12    2026-08-03 08:26    33  **************
  13    2026-08-03 08:27    33  **************
  14    2026-08-03 08:28    32  *************
 ...    ..(  4 skipped).    ..  *************
  19    2026-08-03 08:33    32  *************
  20    2026-08-03 08:34    33  **************
  21    2026-08-03 08:35    32  *************
 ...    ..(  5 skipped).    ..  *************
  27    2026-08-03 08:41    32  *************
  28    2026-08-03 08:42    33  **************
  29    2026-08-03 08:43    32  *************
 ...    ..(  5 skipped).    ..  *************
  35    2026-08-03 08:49    32  *************
  36    2026-08-03 08:50    33  **************
  37    2026-08-03 08:51    33  **************
  38    2026-08-03 08:52    32  *************
 ...    ..(  3 skipped).    ..  *************
  42    2026-08-03 08:56    32  *************
  43    2026-08-03 08:57    33  **************
  44    2026-08-03 08:58    33  **************
  45    2026-08-03 08:59    33  **************
  46    2026-08-03 09:00    32  *************
 ...    ..(  4 skipped).    ..  *************
  51    2026-08-03 09:05    32  *************
  52    2026-08-03 09:06    33  **************
  53    2026-08-03 09:07    32  *************
  54    2026-08-03 09:08    33  **************
  55    2026-08-03 09:09    32  *************
 ...    ..(  3 skipped).    ..  *************
  59    2026-08-03 09:13    32  *************
  60    2026-08-03 09:14     ?  -
  61    2026-08-03 09:15    25  ******
  62    2026-08-03 09:16    25  ******
  63    2026-08-03 09:17    26  *******
  64    2026-08-03 09:18    26  *******
  65    2026-08-03 09:19    27  ********
  66    2026-08-03 09:20    27  ********
  67    2026-08-03 09:21    28  *********
  68    2026-08-03 09:22    28  *********
  69    2026-08-03 09:23    29  **********
  70    2026-08-03 09:24    29  **********
  71    2026-08-03 09:25    29  **********
  72    2026-08-03 09:26    30  ***********
 ...    ..(  2 skipped).    ..  ***********
  75    2026-08-03 09:29    30  ***********
  76    2026-08-03 09:30    31  ************
  77    2026-08-03 09:31    31  ************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             686  ---  Lifetime Power-On Resets
0x01  0x018  6    571419623359  ---  Logical Sectors Written
0x01  0x020  6      1798009835  ---  Number of Write Commands
0x01  0x028  6   1083342809036  ---  Logical Sectors Read
0x01  0x030  6      2270412085  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68392  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68389  ---  Head Flying Hours
0x03  0x018  4           37822  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4            2310  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4              23  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              31  ---  Current Temperature
0x05  0x010  1              35  N--  Average Short Term Temperature
0x05  0x018  1              43  N--  Average Long Term Temperature
0x05  0x020  1              52  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              48  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              45  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2193111  ---  Number of Hardware Resets
0x06  0x010  4         2189793  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            6  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

Serial Number: P8GW7KNP

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GW7KNP
LU WWN Device Id: 5 000cca 22ccc626f
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Aug  3 09:30:30 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   136   136   054    -    83
  3 Spin_Up_Time            POS---   129   129   024    -    496 (Average 469)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5537
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   121   121   020    -    34
  9 Power_On_Hours          -O--C-   090   090   000    -    71205
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    675
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37664
193 Load_Cycle_Count        -O--C-   069   069   000    -    37664
194 Temperature_Celsius     -O----   193   193   000    -    31 (Min/Max 18/50)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      5668         -
# 2  Short offline       Completed without error       00%      2086         -
# 3  Short offline       Completed without error       00%      2064         -
# 4  Short offline       Completed without error       00%      2040         -
# 5  Short offline       Completed without error       00%      2016         -
# 6  Short offline       Completed without error       00%      1992         -
# 7  Short offline       Completed without error       00%      1968         -
# 8  Short offline       Completed without error       00%      1944         -
# 9  Short offline       Completed without error       00%      1920         -
#10  Short offline       Completed without error       00%      1896         -
#11  Short offline       Completed without error       00%      1872         -
#12  Short offline       Completed without error       00%      1848         -
#13  Short offline       Completed without error       00%      1824         -
#14  Short offline       Completed without error       00%      1800         -
#15  Short offline       Completed without error       00%      1776         -
#16  Short offline       Completed without error       00%      1752         -
#17  Short offline       Completed without error       00%      1728         -
#18  Short offline       Completed without error       00%      1704         -
#19  Short offline       Completed without error       00%      1682         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    31 Celsius
Power Cycle Min/Max Temperature:     23/31 Celsius
Lifetime    Min/Max Temperature:     18/50 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (122)

Index    Estimated Time   Temperature Celsius
 123    2026-08-03 07:23    35  ****************
 ...    ..( 21 skipped).    ..  ****************
  17    2026-08-03 07:45    35  ****************
  18    2026-08-03 07:46    36  *****************
  19    2026-08-03 07:47    35  ****************
 ...    ..( 11 skipped).    ..  ****************
  31    2026-08-03 07:59    35  ****************
  32    2026-08-03 08:00    34  ***************
  33    2026-08-03 08:01    34  ***************
  34    2026-08-03 08:02    35  ****************
  35    2026-08-03 08:03    34  ***************
 ...    ..( 27 skipped).    ..  ***************
  63    2026-08-03 08:31    34  ***************
  64    2026-08-03 08:32    33  **************
  65    2026-08-03 08:33    34  ***************
 ...    ..(  2 skipped).    ..  ***************
  68    2026-08-03 08:36    34  ***************
  69    2026-08-03 08:37    33  **************
 ...    ..(  4 skipped).    ..  **************
  74    2026-08-03 08:42    33  **************
  75    2026-08-03 08:43    34  ***************
  76    2026-08-03 08:44    34  ***************
  77    2026-08-03 08:45    33  **************
  78    2026-08-03 08:46    33  **************
  79    2026-08-03 08:47    34  ***************
  80    2026-08-03 08:48    33  **************
 ...    ..(  2 skipped).    ..  **************
  83    2026-08-03 08:51    33  **************
  84    2026-08-03 08:52    34  ***************
  85    2026-08-03 08:53    33  **************
 ...    ..(  4 skipped).    ..  **************
  90    2026-08-03 08:58    33  **************
  91    2026-08-03 08:59    34  ***************
  92    2026-08-03 09:00    34  ***************
  93    2026-08-03 09:01    33  **************
 ...    ..(  4 skipped).    ..  **************
  98    2026-08-03 09:06    33  **************
  99    2026-08-03 09:07    34  ***************
 100    2026-08-03 09:08    34  ***************
 101    2026-08-03 09:09    33  **************
 ...    ..(  3 skipped).    ..  **************
 105    2026-08-03 09:13    33  **************
 106    2026-08-03 09:14     ?  -
 107    2026-08-03 09:15    24  *****
 108    2026-08-03 09:16    25  ******
 109    2026-08-03 09:17    26  *******
 110    2026-08-03 09:18    26  *******
 111    2026-08-03 09:19    27  ********
 112    2026-08-03 09:20    27  ********
 113    2026-08-03 09:21    28  *********
 114    2026-08-03 09:22    28  *********
 115    2026-08-03 09:23    29  **********
 116    2026-08-03 09:24    29  **********
 117    2026-08-03 09:25    29  **********
 118    2026-08-03 09:26    30  ***********
 119    2026-08-03 09:27    30  ***********
 120    2026-08-03 09:28    30  ***********
 121    2026-08-03 09:29    31  ************
 122    2026-08-03 09:30    31  ************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             675  ---  Lifetime Power-On Resets
0x01  0x018  6    574692672775  ---  Logical Sectors Written
0x01  0x020  6      1852886174  ---  Number of Write Commands
0x01  0x028  6   1227144177143  ---  Logical Sectors Read
0x01  0x030  6      2546407047  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68706  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68704  ---  Head Flying Hours
0x03  0x018  4           37664  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4             261  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              31  ---  Current Temperature
0x05  0x010  1              33  N--  Average Short Term Temperature
0x05  0x018  1              32  N--  Average Long Term Temperature
0x05  0x020  1              50  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              45  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              42  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2192359  ---  Number of Hardware Resets
0x06  0x010  4         2189153  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

Serial Number: P8GYSVSR

truenas_admin@DISKSTATION2[~]$ sudo smartctl -x /dev/sdd
[sudo] password for truenas_admin: 
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.12.15-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi/HGST Ultrastar 7K4000
Device Model:     Hitachi HUS724030ALE641
Serial Number:    P8GYSVSR
LU WWN Device Id: 5 000cca 22ccd8857
Firmware Version: MJ8OA5F0
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/6204
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Aug  3 09:26:55 2026 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2], Master PW ID: 0xfffd
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (   24) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   1) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   016    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    85
  3 Spin_Up_Time            POS---   129   129   024    -    494 (Average 474)
  4 Start_Stop_Count        -O--C-   099   099   000    -    5543
  5 Reallocated_Sector_Ct   PO--CK   100   100   005    -    0
  7 Seek_Error_Rate         PO-R--   100   100   067    -    0
  8 Seek_Time_Performance   P-S---   124   124   020    -    33
  9 Power_On_Hours          -O--C-   090   090   000    -    71069
 10 Spin_Retry_Count        PO--C-   100   100   060    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    681
192 Power-Off_Retract_Count -O--CK   069   069   000    -    37715
193 Load_Cycle_Count        -O--C-   069   069   000    -    37715
194 Temperature_Celsius     -O----   193   193   000    -    31 (Min/Max 18/48)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O      7  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x20       GPL     R/O      1  Streaming performance log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80       GPL     R/W     63  Host vendor specific log
0x81-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xb2       GPL     VS      63  Device vendor specific log
0xc8       GPL     VS     617  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      5531         -
# 2  Short offline       Completed without error       00%      1949         -
# 3  Short offline       Completed without error       00%      1928         -
# 4  Short offline       Completed without error       00%      1904         -
# 5  Short offline       Completed without error       00%      1880         -
# 6  Short offline       Completed without error       00%      1856         -
# 7  Short offline       Completed without error       00%      1832         -
# 8  Short offline       Completed without error       00%      1808         -
# 9  Short offline       Completed without error       00%      1784         -
#10  Short offline       Completed without error       00%      1760         -
#11  Short offline       Completed without error       00%      1736         -
#12  Short offline       Completed without error       00%      1712         -
#13  Short offline       Completed without error       00%      1688         -
#14  Short offline       Completed without error       00%      1664         -
#15  Short offline       Completed without error       00%      1640         -
#16  Short offline       Completed without error       00%      1616         -
#17  Short offline       Completed without error       00%      1592         -
#18  Short offline       Completed without error       00%      1568         -
#19  Short offline       Completed without error       00%      1545         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    31 Celsius
Power Cycle Min/Max Temperature:     24/31 Celsius
Lifetime    Min/Max Temperature:     18/48 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (113)

Index    Estimated Time   Temperature Celsius
 114    2026-08-03 07:19    36  *****************
 ...    ..( 31 skipped).    ..  *****************
  18    2026-08-03 07:51    36  *****************
  19    2026-08-03 07:52    35  ****************
 ...    ..( 37 skipped).    ..  ****************
  57    2026-08-03 08:30    35  ****************
  58    2026-08-03 08:31    34  ***************
  59    2026-08-03 08:32    35  ****************
 ...    ..(  3 skipped).    ..  ****************
  63    2026-08-03 08:36    35  ****************
  64    2026-08-03 08:37    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  69    2026-08-03 08:42    34  ***************
  70    2026-08-03 08:43    35  ****************
  71    2026-08-03 08:44    35  ****************
  72    2026-08-03 08:45    34  ***************
 ...    ..(  4 skipped).    ..  ***************
  77    2026-08-03 08:50    34  ***************
  78    2026-08-03 08:51    35  ****************
  79    2026-08-03 08:52    35  ****************
  80    2026-08-03 08:53    35  ****************
  81    2026-08-03 08:54    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  85    2026-08-03 08:58    34  ***************
  86    2026-08-03 08:59    35  ****************
  87    2026-08-03 09:00    35  ****************
  88    2026-08-03 09:01    35  ****************
  89    2026-08-03 09:02    34  ***************
  90    2026-08-03 09:03    34  ***************
  91    2026-08-03 09:04    35  ****************
  92    2026-08-03 09:05    34  ***************
  93    2026-08-03 09:06    34  ***************
  94    2026-08-03 09:07    35  ****************
  95    2026-08-03 09:08    35  ****************
  96    2026-08-03 09:09    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 100    2026-08-03 09:13    34  ***************
 101    2026-08-03 09:14     ?  -
 102    2026-08-03 09:15    25  ******
 103    2026-08-03 09:16    26  *******
 104    2026-08-03 09:17    26  *******
 105    2026-08-03 09:18    27  ********
 106    2026-08-03 09:19    28  *********
 107    2026-08-03 09:20    28  *********
 108    2026-08-03 09:21    29  **********
 109    2026-08-03 09:22    29  **********
 110    2026-08-03 09:23    29  **********
 111    2026-08-03 09:24    30  ***********
 112    2026-08-03 09:25    30  ***********
 113    2026-08-03 09:26    31  ************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4             681  ---  Lifetime Power-On Resets
0x01  0x018  6    612153774079  ---  Logical Sectors Written
0x01  0x020  6      1824039063  ---  Number of Write Commands
0x01  0x028  6   1150777198718  ---  Logical Sectors Read
0x01  0x030  6      2365984204  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           68525  ---  Spindle Motor Power-on Hours
0x03  0x010  4           68522  ---  Head Flying Hours
0x03  0x018  4           37715  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4              21  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               1  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              31  ---  Current Temperature
0x05  0x010  1              34  N--  Average Short Term Temperature
0x05  0x018  1              34  N--  Average Long Term Temperature
0x05  0x020  1              48  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              44  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              42  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4         2191759  ---  Number of Hardware Resets
0x06  0x010  4         2188703  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0009  2            5  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            1  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS

SmallBarky · August 3, 2026, 3:11pm

Try searching the forum for ‘Invalid Label’ issues and see if anyone has walked them through a fix. We can wait to see if @HoneyBadger or anyone else replies.

Samuel_Tai · August 3, 2026, 3:29pm

That’s a drive failing.

JoeTheSailor · August 3, 2026, 5:10pm

Big Thank You to @Samuel_Tai and @SmallBarky for the support and guidance. I have found a thread that address this sort of issue (help-pool-vanished-on-truenas-scale-install/51661).

I have ordered a replacement disk that will be here tomorrow morning. I plan to attempt to Backup and Repair the GPT data see if I can bring the pool back. If not, I will wipe the disks and rebuild form scratch and then restore my backups. Wish me luck.

marek · August 3, 2026, 6:37pm

As I mentioned in my thread, I ran sudo fdisk -l [drive] on every disk that should be part of the pool, and that’s where I saw the GPT corruption error messages.

If you’re not seeing the same errors, it’s likely a different underlying issue, so my solution probably won’t help you here.

JoeTheSailor · August 3, 2026, 7:39pm

Thx @marek , I have that step in my work plan for tomorrow to see if your solution will apply. Thanks again.

JoeTheSailor · August 4, 2026, 9:20pm

Ok, so I’m not sure I have made any real progress toward recovering my pool. Here is where things stand. After going through the GPT backup and repair process outlines below (thx @marek )

Any further suggestions on how I can breath life back into the pool long enough to replace the disk that is showing signs of failing (23 — Number of Reported Uncorrectable Errors Serial Number: P8G8V87R).

Here is the solution I carried out:

Backup the GPT
sudo gdisk /dev/sdX

Entered b to back up GPT data to a file (I set the filename to the drive’s serial number)

Run for all affected disks.

Repairing the GPT
sudo gdisk /dev/sdX

Entered r to access the recovery & transformation menu
Entered b to use backup GPT header (rebuilding main)
Entered w to write data. Use this command to save your changes.

truenas_admin@DISKSTATION2[~]$ sudo zpool import
  pool: Master_Pool
    id: 3794440546214538116
 state: UNAVAIL
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-5E
config:

        Master_Pool                               UNAVAIL  insufficient replicas
          raidz1-0                                UNAVAIL  insufficient replicas
            50edd73c-ba26-4da1-89d1-a890abdbd997  UNAVAIL  invalid label
            825ba380-83ec-4cdd-a9a2-e886e2b2b276  ONLINE
            6eac2201-7f6d-436d-8dc7-cd0db703e581  ONLINE
            6936695650409622532                   UNAVAIL  invalid label

truenas_admin@DISKSTATION2[~]$ sudo lsblk -bo NAME,LABEL,MAJ:MIN,TRAN,ROTA,ZONED,VENDOR,MODEL,SERIAL,PARTUUID,START,SIZE,PARTTYPENAME
NAME LABEL  MAJ:MIN TRAN   ROTA ZONED VENDOR MODEL SERIAL PARTUUID                               START          SIZE PARTTYPENAME
sda           8:0   sata      1 none  ATA    Hitac P8G8V8                                              3000592982016 
└─sda1
              8:1             1 none                      d82b35fe-ad3e-49aa-a21b-4fcaaa3d132e    2048 2998445015040 Solaris /usr & Apple ZFS
sdb           8:16  sata      1 none  ATA    Hitac P8GZ30                                              3000592982016 
└─sdb1
              8:17            1 none                      50edd73c-ba26-4da1-89d1-a890abdbd997    2048 2998445015040 Solaris /usr & Apple ZFS
sdc           8:32  sata      1 none  ATA    Hitac P8GW7K                                              3000592982016 
└─sdc1
     Master_Pool
              8:33            1 none                      6eac2201-7f6d-436d-8dc7-cd0db703e581    2048 2998445015040 Solaris /usr & Apple ZFS
sdd           8:48  sata      1 none  ATA    HGST  NAG3UG                                              6001175126016 
sde           8:64  sata      1 none  ATA    Hitac P8GYSV                                              3000592982016 
└─sde1
     Master_Pool
              8:65            1 none                      825ba380-83ec-4cdd-a9a2-e886e2b2b276    2048 2998445015040 Solaris /usr & Apple ZFS
sdf           8:80  sata      0 none  ATA    Samsu S3YHNX                                               250059350016 
├─sdf1
│             8:81            0 none                      17fd9e79-960f-4442-b8d6-8ed14088bd43    4096       1048576 BIOS boot
├─sdf2
│    EFI      8:82            0 none                      54120ac9-45ae-4dec-bc4a-ec1caf69347a    6144     536870912 EFI System
└─sdf3
     boot-pool
              8:83            0 none                      9c9b7456-78c7-4f19-a87e-e8f8ce26a168 1054720  249519316480 Solaris /usr & Apple ZFS

truenas_admin@DISKSTATION2[~]$ sudo zdb -l /dev/sda
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
truenas_admin@DISKSTATION2[~]$ sudo zdb -l /dev/sdb
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
truenas_admin@DISKSTATION2[~]$ sudo zdb -l /dev/sdc
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
truenas_admin@DISKSTATION2[~]$ sudo zdb -l /dev/sdd
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3

sudo zdb -U /data/zfs/zpool.cache
Master_Pool:
    version: 5000
    name: 'Master_Pool'
    state: 0
    txg: 2510975
    pool_guid: 3794440546214538116
    errata: 0
    hostid: 1489919046
    hostname: 'DISKSTATION2'
    com.delphix:has_per_vdev_zaps
    vdev_children: 1
    vdev_tree:
        type: 'root'
        id: 0
        guid: 3794440546214538116
        create_txg: 4
        com.klarasystems:vdev_zap_root: 129
        children[0]:
            type: 'raidz'
            id: 0
            guid: 11261797279433721529
            nparity: 1
            metaslab_array: 65
            metaslab_shift: 34
            ashift: 12
            asize: 11993761185792
            is_log: 0
            create_txg: 4
            com.delphix:vdev_zap_top: 130
            children[0]:
                type: 'disk'
                id: 0
                guid: 3103104782968973553
                path: '/dev/disk/by-partuuid/50edd73c-ba26-4da1-89d1-a890abdbd997'
                whole_disk: 0
                DTL: 3150
                create_txg: 4
                com.delphix:vdev_zap_leaf: 131
            children[1]:
                type: 'disk'
                id: 1
                guid: 5328913318255481285
                path: '/dev/disk/by-partuuid/825ba380-83ec-4cdd-a9a2-e886e2b2b276'
                whole_disk: 0
                DTL: 3149
                create_txg: 4
                com.delphix:vdev_zap_leaf: 132
            children[2]:
                type: 'disk'
                id: 2
                guid: 10984462085616704570
                path: '/dev/disk/by-partuuid/6eac2201-7f6d-436d-8dc7-cd0db703e581'
                whole_disk: 0
                DTL: 3148
                create_txg: 4
                com.delphix:vdev_zap_leaf: 133
            children[3]:
                type: 'disk'
                id: 3
                guid: 6936695650409622532
                path: '/dev/disk/by-partuuid/d82b35fe-ad3e-49aa-a21b-4fcaaa3d132e'
                whole_disk: 0
                not_present: 1
                DTL: 3147
                create_txg: 4
                com.delphix:vdev_zap_leaf: 134
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2

ZFS_DBGMSG(zdb) START:
metaslab.c:1687:spa_set_allocator(): spa allocator: dynamic
ZFS_DBGMSG(zdb) END

marek · August 5, 2026, 12:24am

Was your old system up to date, and is the new system on the latest version of TrueNAS? Also, was this a SCALE-to-SCALE migration?

Here are some links.

github.com/openzfs/zfs

label missing or invalid after reboot

opened 09:52PM - 17 Mar 14 UTC

closed 06:25PM - 18 Mar 14 UTC

garlough

Type: Documentation

Using zfs 0.6.1 on CentOS 6.3, with kernel 2.6.32, rebooting the system after cr…eating a pool with one LUN, zpool reports the status as: "One or more devices could not be used because the label is missing or invalid. There are insufficient replicas for the pool to continue functioning." This problem manifests itself on when disk devices are used, but not when a file-based filesystem is used. The config line of zpool status is: config: ``` NAME STATE READ WRITE CKSUM lustre-ost1 UNAVAIL 0 0 0 insufficient replicas scsi-360001ff090aae000000000008bd10000 UNAVAIL 0 0 0 ``` Parted doesn't report a problem with partition table.

https://serverfault.com/questions/1089447/zfs-does-not-recognize-its-own-physical-disks

JoeTheSailor · August 5, 2026, 12:52am

@marek thx for the links. I’ll take a look.

It was not a migration. This all started with simple PC case swap. Lift and shift the guts of the server into a new box with better airflow and quieter fans. The MB swap was just part of my trouble shooting to make sure i didn’t have a bad SATA port, or something. It is running on Version: 25.04.2.6.

marek · August 5, 2026, 1:13am

You are 10 months out of date.

Topic		Replies	Views
Truenas Core Uncorrectable I/O failure on storage pool TrueNAS General CORE	23	190	July 10, 2025
SMART Tests Haven't Been Running? TrueNAS General	162	1462	September 21, 2025
Device: /dev/sda [SAT], Self-Test Log error count increased: shows wrong disc TrueNAS General Bug	16	189	October 18, 2025
Currently Unreadable (pending) Sectors all over system TrueNAS General SCALE , Hardware	12	559	April 22, 2025
Zpool CHKSUM - Help needed TrueNAS General	18	243	November 13, 2025

Vdev Offline - Disks with exported pools not accessible, but SMART reports no errors

Alerts

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog” dataset(s) required for starting docker.

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/truenas_catalog” dataset(s) required for starting docker.

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/app_mounts” dataset(s) required for starting docker.

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/app_configs, Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts” dataset(s) required for starting docker.

Critical

Failed to configure docker for Applications: Missing “Master_Pool/ix-apps/truenas_catalog, Master_Pool/ix-apps/docker, Master_Pool/ix-apps/app_mounts, Master_Pool/ix-apps/app_configs” dataset(s) required for starting docker.

Critical

SMB shares have path-related configuration issues that may impact service stability: Backups: Path does not exist., DS410j: Path does not exist., music: Path does not exist., video: Path does not exist., photos: Path does not exist.

Critical

Pool Master_Pool state is OFFLINE: None

Related topics