Hi all,
After many years of debating off the shelf vs DIY NAS’s, I finally decided to take the plunge and went the DIY route. Whilst my PC building skills are good and my DOS knowledge is (probably was now…) decent, my Linux knowledge is lacking, hence the whole DIY route also being a learning curve!
The hardware is a HP Microserver Gen8 with upgraded CPU to i5-3470T, 16Gb ECC Ram, LSI 9212 HBA Card with 4x 3Gb SAS drives in Raid1z and 2x240Gb SDD in Mirror for meta. Boot is off a 32Gb endurance SD card, running Dragonfish-24.04.2.2.
Ideally, I wanted to play around with various containers and dockage related items, but even before I could start that joruney I was greeted with
“Alerts”
Pool swimming state is DEGRADED: One or more devices could not be used because the lable is missing or invalid. Sufficent replicas exist for the pool to continue fuctioning in a degraded state.
The following devices are not healthy:
Disk MB3000FBNWV Z292Y5QQ00009244E57G is UNAVAIL
Steps performed so far.
Power downed and check all cables, ports and drives are secure
Ton of googling to figure out what this means
What I thought I could have done is given the drive seems to show in the Storage Dashboard as 1 Unassigned Disks, I could press the Add To Pool button and go through the motions, but this doesnt allow me to add 1 drive to the existing pool as it says its not enough drives to do so (can send s/s if needed)
Therefore, I think what I need to do is to Export the pool (unticking destroy and delete config) and Import the pool again, but I dont know if I need to “save” any config anywhere prior and where to do “import” from and what this means for the data in the pool.
Doing what seems advance, but basic to you guys is some tests and i see that sdc is the one thats dropped out, but i dont get how or why or now what to do to “put it back in”.
lsblk
admin@truenas[~]$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 2.7T 0 disk
├─sda1 8:1 0 2G 0 part
│ └─md127 9:127 0 2G 0 raid1
│ └─md127 253:1 0 2G 0 crypt
└─sda2 8:2 0 2.7T 0 part
sdb 8:16 0 2.7T 0 disk
├─sdb1 8:17 0 2G 0 part
│ └─md126 9:126 0 2G 0 raid1
│ └─md126 253:0 0 2G 0 crypt
└─sdb2 8:18 0 2.7T 0 part
sdc 8:32 0 0B 0 disk
sdd 8:48 0 2.7T 0 disk
├─sdd1 8:49 0 2G 0 part
│ └─md126 9:126 0 2G 0 raid1
│ └─md126 253:0 0 2G 0 crypt
└─sdd2 8:50 0 2.7T 0 part
sde 8:64 0 29.7G 0 disk
├─sde1 8:65 0 1M 0 part
├─sde2 8:66 0 512M 0 part
└─sde3 8:67 0 13.9G 0 part
sdf 8:80 0 223.6G 0 disk
└─sdf1 8:81 0 223.6G 0 part
sdg 8:96 0 223.6G 0 disk
└─sdg1 8:97 0 223.6G 0 part
admin@truenas[~]$
zpool status -v
admin@truenas[~]$ sudo zpool status -v
[sudo] password for admin:
pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:05:21 with 0 errors on Sat Oct 12 03:50:23 2024
config:
NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
usb-HP_iLO_Internal_SD-CARD_000002660A01-0:0-part3 ONLINE 0 0 0
errors: No known data errors
pool: swimming
state: DEGRADED
status: One or more devices could not be used because the label is missing or
invalid. Sufficient replicas exist for the pool to continue
functioning in a degraded state.
action: Replace the device using 'zpool replace'.
see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-4J
scan: scrub repaired 0B in 00:07:24 with 0 errors on Wed Oct 16 13:39:11 2024
config:
NAME STATE READ WRITE CKSUM
swimming DEGRADED 0 0 0
raidz1-0 DEGRADED 0 0 0
3252fd4c-4b6a-4a42-8f0d-6b0192f76d9d ONLINE 0 0 0
65dd5986-43f2-4ec5-ad4e-b9f070d43749 ONLINE 0 0 0
3038990180868011873 UNAVAIL 0 0 0 was /dev/disk/by-partuuid/e00549c2-3561-435a-99aa-bea96ee0986a
2954b660-800c-4f87-9fa2-84ce4ea439c9 ONLINE 0 0 0
special
mirror-1 ONLINE 0 0 0
5fc5e1d5-ee2c-4761-8229-65c7acc18856 ONLINE 0 0 0
95fb2eeb-b758-4837-bfa2-9a1e8882df13 ONLINE 0 0 0
errors: No known data errors
zfs list
admin@truenas[~]$ sudo zfs list
NAME USED AVAIL REFER MOUNTPOINT
boot-pool 4.81G 8.27G 96K none
boot-pool/ROOT 4.79G 8.27G 96K none
boot-pool/ROOT/24.04.0 2.39G 8.27G 164M legacy
boot-pool/ROOT/24.04.0/audit 140K 8.27G 140K /audit
boot-pool/ROOT/24.04.0/conf 140K 8.27G 140K /conf
boot-pool/ROOT/24.04.0/data 88K 8.27G 272K /data
boot-pool/ROOT/24.04.0/etc 6.53M 8.27G 5.63M /etc
boot-pool/ROOT/24.04.0/home 0B 8.27G 116K /home
boot-pool/ROOT/24.04.0/mnt 96K 8.27G 96K /mnt
boot-pool/ROOT/24.04.0/opt 74.1M 8.27G 74.1M /opt
boot-pool/ROOT/24.04.0/root 8K 8.27G 156K /root
boot-pool/ROOT/24.04.0/usr 2.12G 8.27G 2.12G /usr
boot-pool/ROOT/24.04.0/var 31.8M 8.27G 30.3M /var
boot-pool/ROOT/24.04.0/var/ca-certificates 96K 8.27G 96K /var/local/ca-certificates
boot-pool/ROOT/24.04.0/var/log 448K 8.27G 3.32M /var/log
boot-pool/ROOT/24.04.2.2 2.41G 8.27G 164M legacy
boot-pool/ROOT/24.04.2.2/audit 372K 8.27G 372K /audit
boot-pool/ROOT/24.04.2.2/conf 132K 8.27G 132K /conf
boot-pool/ROOT/24.04.2.2/data 516K 8.27G 280K /data
boot-pool/ROOT/24.04.2.2/etc 6.59M 8.27G 5.63M /etc
boot-pool/ROOT/24.04.2.2/home 216K 8.27G 128K /home
boot-pool/ROOT/24.04.2.2/mnt 96K 8.27G 96K /mnt
boot-pool/ROOT/24.04.2.2/opt 74.1M 8.27G 74.1M /opt
boot-pool/ROOT/24.04.2.2/root 272K 8.27G 172K /root
boot-pool/ROOT/24.04.2.2/usr 2.12G 8.27G 2.12G /usr
boot-pool/ROOT/24.04.2.2/var 46.2M 8.27G 32.1M /var
boot-pool/ROOT/24.04.2.2/var/ca-certificates 96K 8.27G 96K /var/local/ca-certificates
boot-pool/ROOT/24.04.2.2/var/log 13.1M 8.27G 12.7M /var/log
boot-pool/grub 8.16M 8.27G 8.16M legacy
swimming 351G 7.46T 96K /mnt/swimming
swimming/.system 1.34G 7.46T 1.23G legacy
swimming/.system/configs-8f179c8648fc4419af075a5cf26c19f8 827K 7.46T 827K legacy
swimming/.system/cores 96K 1024M 96K legacy
swimming/.system/netdata-8f179c8648fc4419af075a5cf26c19f8 112M 7.46T 112M legacy
swimming/.system/samba4 243K 7.46T 243K legacy
swimming/test 349G 7.46T 349G /mnt/swimming/test
admin@truenas[~]$
sas2flash -list
admin@truenas[~]$ sudo sas2flash -list
LSI Corporation SAS2 Flash Utility
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved
Adapter Selected is a LSI SAS: SAS2308_2(D1)
Controller Number : 0
Controller : SAS2308_2(D1)
PCI Address : 00:07:00:00
SAS Address : 500605b-0-0cf8-aba0
NVDATA Version (Default) : 11.00.00.02
NVDATA Version (Persistent) : 11.00.00.02
Firmware Product ID : 0x2714 (IR)
Firmware Version : 18.00.00.00
NVDATA Vendor : LSI
NVDATA Product ID : SAS9217-4i4e
BIOS Version : N/A
UEFI BSD Version : N/A
FCODE Version : N/A
Board Name : SAS9217-4i4e
Board Assembly : 03-25597-01B
Board Tracer Number : SP72519732
Finished Processing Commands Successfully.
Exiting SAS2Flash.
admin@truenas[~]$
Hope theres enough information to help me out and looking to learn as well so thank you in advance!