TrueNAS-13.0-U6.2
Intel(R) Celeron(R) J4105 CPU @ 1.50GHz
15.6GiB
2 Western Digital Nas Driver as Raid
1 Normal Drive
1 Normal Drive
Hello everyone,
I hope you can help me. I’m not very familiar with TrueNAS. I set up a server back then, and it has been running very well until now. Suddenly, my hard drives appear as “Offline” on the dashboard. What could be the reason for this? Is it possible to bring them back online?
Hi, hard to express an opinion… something Is sure going very wrong in your system, and i think there are some bad choice that i hope you will not regret now (stripe pools and SMR disks)…
Can you share a zpool status and a disk list?
Why are you running RAID on ZFS?
The zpool status output Is complete? There Is only the boot pool.
If you can don’t use the GUI Shell, with Putty or similar copy the output and paste here including double `.
A camcontrol devlist output can be usefull too
root@freenas[~]# zpool status
pool: freenas-boot
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:00:27 with 0 errors on Fri Sep 27 03:45:27 2024
config:
NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
da0p2 ONLINE 0 0 0
errors: No known data errors
root@freenas[~]# camcontrol devlist
<WDC WD40EFRX-68WT0N0 82.00A82> at scbus0 target 0 lun 0 (pass3,ada2)
<WDC WD40EFRX-68WT0N0 82.00A82> at scbus1 target 0 lun 0 (pass2,ada1)
<WDC WD40EFAX-68JH4N0 82.00A82> at scbus3 target 0 lun 0 (pass1,ada0)
<ASMT 2115 0> at scbus4 target 0 lun 0 (da0,pass0)
Honestly, seems like your pools has been disconnected, with your disks now no party of a pools.
The risk to worsening the situation Is high, so meanwhile check disk status and let’s see if someone Is fail or if the mainboard controller have had a critical issue: smartctl -a /dev/ and add adaX for each disks you have.
Check if via GUI you can import One of those pools
What does this mean?
Are you implying these are two drives (directly connected to SATA ports on your motherboard) that are configured into a mirror vdev?
You’re not suggesting that they are plugged into a “hardware RAID controller”?
Yes, the two drives are connected as RAID to the motherboard, not to a RAID controller.
What does that mean?
You configured them as “RAID” in a motherboard/BIOS setting?
Many users in the forums tend to mix up the terms “RAID” with a mirror or RAIDZ vdev (i.e, ZFS “RAID”).
root@freenas[~]# smartctl -a /dev/ada0
smartctl 7.2 2021-09-14 r5236 [FreeBSD 13.1-RELEASE-p9 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red (SMR)
Device Model: WDC WD40EFAX-68JH4N0
Serial Number: WD-WX52D104LK9S
LU WWN Device Id: 5 0014ee 2bcffce48
Firmware Version: 82.00A82
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Form Factor: 3.5 inches
TRIM Command: Available, deterministic, zeroed
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Mon Sep 30 15:58:34 2024 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (14580) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off supp ort.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 33) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3039) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0
3 Spin_Up_Time 0x0027 217 199 021 Pre-fail Always - 2141
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 994
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 074 074 000 Old_age Always - 19246
10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 973
192 Power-Off_Retract_Count 0x0032 199 199 000 Old_age Always - 893
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 239
194 Temperature_Celsius 0x0022 109 094 000 Old_age Always - 38
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0
SMART Error Log Version: 1
ATA Error Count: 215 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 215 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 01 00 00 00 40 08 00:04:47.440 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.410 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
Error 214 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 01 00 00 00 40 08 00:04:47.410 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
Error 213 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
Error 212 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
c6 00 10 00 00 00 40 08 00:04:47.317 SET MULTIPLE MODE
Error 211 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
c6 00 10 00 00 00 40 08 00:04:47.317 SET MULTIPLE MODE
ef 10 02 00 00 00 40 08 00:04:47.317 SET FEATURES [Enable SATA feature]
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA _of_first_error
# 1 Extended offline Completed without error 00% 19246 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
This kind of drives (WD40EFAX) are SMR and as such not good choice for NAS environment. Replace them with CMR Red drives (WD40EFRX) or even better with Red Plus ones (WD40EFPX, WD40EFZX).
Please, use the triple ` when you past content, or is not even readable.
root@freenas[~]# smartctl -a /dev/ada0
smartctl 7.2 2021-09-14 r5236 [FreeBSD 13.1-RELEASE-p9 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, [www.smartmontools.org](http://www.smartmontools.org/)
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red (SMR)
Device Model: WDC WD40EFAX-68JH4N0
Serial Number: WD-WX52D104LK9S
LU WWN Device Id: 5 0014ee 2bcffce48
Firmware Version: 82.00A82
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Form Factor: 3.5 inches
TRIM Command: Available, deterministic, zeroed
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Mon Sep 30 15:58:34 2024 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (14580) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off supp ort.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 33) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3039) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0
3 Spin_Up_Time 0x0027 217 199 021 Pre-fail Always - 2141
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 994
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 074 074 000 Old_age Always - 19246
10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 973
192 Power-Off_Retract_Count 0x0032 199 199 000 Old_age Always - 893
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 239
194 Temperature_Celsius 0x0022 109 094 000 Old_age Always - 38
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0
SMART Error Log Version: 1
ATA Error Count: 215 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It “wraps” after 49.710 days.
Error 215 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
---
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
---
c8 00 01 00 00 00 40 08 00:04:47.440 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.410 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
Error 214 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
---
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
---
c8 00 01 00 00 00 40 08 00:04:47.410 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
Error 213 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
---
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
---
c8 00 01 00 00 00 40 08 00:04:47.380 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
Error 212 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
---
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
---
c8 00 01 00 00 00 40 08 00:04:47.349 READ DMA
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
c6 00 10 00 00 00 40 08 00:04:47.317 SET MULTIPLE MODE
Error 211 occurred at disk power-on lifetime: 19243 hours (801 days + 19 hours)
When the command that caused the error occurred, the device was active or idle .
After command completion occurred, registers were:
ER ST SC SN CL CH DH
---
04 61 01 00 00 00 40 Device Fault; Error: ABRT 1 sectors at LBA = 0x00000000 = 0
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
---
c8 00 01 00 00 00 40 08 00:04:47.319 READ DMA
ef 02 00 00 00 00 40 08 00:04:47.319 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 40 08 00:04:47.318 SET FEATURES [Enable read look-ahea d]
c6 00 10 00 00 00 40 08 00:04:47.317 SET MULTIPLE MODE
ef 10 02 00 00 00 40 08 00:04:47.317 SET FEATURES [Enable SATA feature]
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA _of_first_error
# 1 Extended offline Completed without error 00% 19246 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
The disk not seems faulting itself, but a lot of error has been threwed… i think GODwinni point in the right direction, you shuldn’t use hw RAID on TN, but honestly i don’t know how help you there sorry
Thank you.
Do you know how i can recover the Files in the Drives?
First, try to fully answer @winnielinnie 's questions: What do you mean by “as Raid”? How was the pool configured?
The pool name “RAID” is irrelevant.
There are two drives in there, one of which has had errors (=> replacement). This should not make a ZFS mirror pool unavailable, but would be deadly for a ZFS stripe.
Or, worse still, you had configured the drives as RAID0 on the board’s controller and used that as another single “drive” pool of 8 TB. If you mean THAT we want to know! (And if it was plain AHCI, we’d like confirmation too.)
If this was a non-redundant pool, your only hope is Klennet ZFS Recovery. Preferably running on this very motherboard if you had a hardware RAID setup because then the controller is part of the problem.
Output of zpool import please?
Also, suggested readings: Terminology and Abbreviations Primer | TrueNAS Community, Introduction to ZFS | TrueNAS Community, iX's ZFS Pool Layout White Paper, What's all the noise about HBAs, and why can't I use a RAID controller? | TrueNAS Community.
Hello,
Thank you for the quick reply.
As far as I can remember, I had set up the RAID pool so that the two hard drives mirrored each other.