After replaing HDD's, the Pools show different disks etcc and some strange behaviour

TrueNAS General
1

Hope this makes sense….

Back Story - I had some drives start to fail, so I started with what seemed to be succsesful swap of problem drives. Took out old failing 2tb SAS drives and replaced with 6tb SAS. Resilver took overnight and I started this process with the intention of swapping ALL drives out. Seemed to be going really well UNTIL i shut the computer/server down for a weekend. When I rerstarted it, i was getting an error on on one of the new drives. So I swpapped it. After the restart, the pools went weird. When originally setup the all 12 drives were used in 1 setup, but split into 2 pools of 6 (correct termoiinology?) Pool 1 was drives 1-6 and next was 7-12/ Aftrer restart, pool 1 had drives 1,3,5,9,11,12 or similar. Is this normal behaviour? Also after replacing disk 10, it didnt say resilver, just said it was online?

So, should I just start fresh and download my cloud backup? Or should I keep going with reilver… Also, after trying to chnage drives, I was getting some kind of PEARL error

Any help would be great

2

Please post complete details on your hardware, OS version and pool layouts. Looking for something like what shows in my Details section of my sig when it’s expanded. How drives are attached and if you are using an HBA, we may check that info for firmware and verify it has IT mode set.
It sounds like you are describing some sort of Raid-Z(1,2,3) with two VDEVs, each VDEV is six drives wide. I don’t think the drives moving around is a problem as drive names can change at boot but the serial numbers should stay put to their respective VDEV.

3

OK, Sorry, Wasnt being vague on purpose. All a bit scary for me.

System

IDM Sever

12 drives with HBA controller

2 x VDevs of 6 drives each.

OS - Latest Truenas (Not scale)

Cant take photos. I have shut it down. Too scared to start it right now

Thanks for the reference on the Drive letters changing at boot. I’ll look at the serials.

Also, when I did last swap, it is also showing a drive as removed. but it isnt removed and can clearly see it in the disk section.

4

When you look at your TrueNAS dashboard (GUI), does it show the OS version, under System Informattion, as TrueNAS Core? Is it 13.0u6 or 13.3? The version helps a little with what commands can run. Are you comfortable using the command line Shell or would screenshots be better? I use snipping tool on Window 11 for my screenshots. We can work with either to see your system info.

Link to the online documents for TrueNAS Core 13.0 series. If on 13.3, probably the same docs?

Browse some other threads and do the Tutorial by the Bot to get your forum trust level up and post images and links

TrueNAS-Bot
Type this in a new reply and send to bring up the tutorial, if you haven’t done it already.
@TrueNAS-Bot start tutorial

5

Which HBA controller and is it in IT mode?

Also, please read this posting. It is actually not that long since you would use a specific section for your problem. But it provides commands to run based on the problem at hand, and then you can post those to this thread so we can help you out.

And welcome to the forums, wish it were under better circumstances.