One or more devices has experienced an unrecoverable error

Hi, I woke up to the following error message yesterday.

CRITICAL

Pool volume1 state is ONLINE: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected.

Ran a long smart test which I think is completed by now… Any help on what I’m seeing?

Thanks

root@freenas:~ # smartctl -a /dev/da0
smartctl 7.2 2021-09-14 r5236 [FreeBSD 13.1-RELEASE-p9 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar He10/12
Device Model:     WDC WD100EMAZ-00WJTA0
Serial Number:    xxxxxxxx
LU WWN Device Id: 5 000cca 273e05f2b
Firmware Version: 83.H0A83
User Capacity:    10,000,831,348,736 bytes [10.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Oct  6 07:04:29 2024 EDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (   93) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1164) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000b   100   100   016    Pre-fail  Always       -       0
  2 Throughput_Performance  0x0004   129   129   054    Old_age   Offline      -       112
  3 Spin_Up_Time            0x0007   155   155   024    Pre-fail  Always       -       409 (Average 437)
  4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       108
  5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000a   100   100   067    Old_age   Always       -       0
  8 Seek_Time_Performance   0x0004   128   128   020    Old_age   Offline      -       18
  9 Power_On_Hours          0x0012   093   093   000    Old_age   Always       -       51242
 10 Spin_Retry_Count        0x0012   100   100   060    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       108
 22 Helium_Level            0x0023   100   100   025    Pre-fail  Always       -       100
192 Power-Off_Retract_Count 0x0032   098   098   000    Old_age   Always       -       2456
193 Load_Cycle_Count        0x0012   098   098   000    Old_age   Always       -       2456
194 Temperature_Celsius     0x0002   191   191   000    Old_age   Always       -       34 (Min/Max 18/41)
196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0

SMART Error Log Version: 1
ATA Error Count: 2
        CR = Command Register [HEX]
        FR = Features Register [HEX]
        SC = Sector Count Register [HEX]
        SN = Sector Number Register [HEX]
        CL = Cylinder Low Register [HEX]
        CH = Cylinder High Register [HEX]
        DH = Device/Head Register [HEX]
        DC = Device Command Register [HEX]
        ER = Error register [HEX]
        ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 2 occurred at disk power-on lifetime: 51209 hours (2133 days + 17 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 41 00 00 00 00 00  Error: UNC at LBA = 0x00000000 = 0

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 08 80 02 e9 40 00  29d+01:53:25.548  READ FPDMA QUEUED
  2f 00 01 10 00 00 00 00  29d+01:53:25.548  READ LOG EXT
  61 08 38 90 29 ce 40 00  29d+01:53:22.488  WRITE FPDMA QUEUED
  61 10 38 78 29 2d 40 00  29d+01:53:22.488  WRITE FPDMA QUEUED
  61 08 38 48 62 60 40 00  29d+01:53:22.487  WRITE FPDMA QUEUED

Error 1 occurred at disk power-on lifetime: 51209 hours (2133 days + 17 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 41 00 00 00 00 00  Error: UNC at LBA = 0x00000000 = 0

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 80 00 e9 40 00  29d+01:53:18.393  READ FPDMA QUEUED
  60 e0 08 c8 05 e9 40 00  29d+01:53:18.365  READ FPDMA QUEUED
  60 40 38 80 05 e9 40 00  29d+01:53:11.313  READ FPDMA QUEUED
  60 00 30 80 04 e9 40 00  29d+01:53:11.313  READ FPDMA QUEUED
  60 00 28 80 03 e9 40 00  29d+01:53:11.313  READ FPDMA QUEUED

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     51242         -
# 2  Extended offline    Completed without error       00%     51236         -
# 3  Short offline       Completed without error       00%     51215         -
# 4  Short offline       Completed without error       00%     50999         -
# 5  Extended offline    Completed without error       00%     50922         -
# 6  Short offline       Completed without error       00%     50831         -
# 7  Short offline       Completed without error       00%     50663         -
# 8  Extended offline    Completed without error       00%     50586         -
# 9  Short offline       Completed without error       00%     50495         -
#10  Short offline       Completed without error       00%     50255         -
#11  Extended offline    Completed without error       00%     50178         -
#12  Short offline       Completed without error       00%     50087         -
#13  Short offline       Completed without error       00%     49919         -
#14  Extended offline    Completed without error       00%     49842         -
#15  Short offline       Completed without error       00%     49751         -
#16  Short offline       Completed without error       00%     49511         -
#17  Extended offline    Completed without error       00%     49434         -
#18  Short offline       Completed without error       00%     49343         -
#19  Short offline       Completed without error       00%     49180         -
#20  Extended offline    Completed without error       00%     49103         -
#21  Short offline       Completed without error       00%     49012         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Looks like the attempt to correct the error was successful as the last long test ran clean.
I would just monitor.