SAS Failed after update from 25.04.1 to 25.04.2

TrueNAS General
1

I use an LSI SAS 9860 -8e Controller.
I use 2x EMC Enclosures
Bios is updated to work on 25.04.1

Since 25.04.2 update Truenas fails to initialise SAS Controller.
Looks like the driver version on 25.04.2 has been rolled back so now the updated SAS bios does not work.

Will this be fixed asap. I need access to my SAS Drives…

2

Can you not just boot back in the one that works?

2 Likes
3

Can you run these and post back the results for the command that works?
Please use Preformatted text mode </> or Ctrl+e

sudo sas2flash -list
sudo sas3flash -list
sudo storcli show all

You may want to use the Report a Bug in the TrueNAS GUI. Smile icon on upper right for Feedback / Report a Bug. Please upload a debug dump also.

4

storcli no longer sees controller.
LSI MegaRaid SAS 9286-8e

What do I need to do.

#storecli show all
CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.12.15-production+truenas
Status Code = 0
Status = Success
Description = None

Number of Controllers = 0
Host Name = truenas
Operating System = Linux 6.12.15-production+truenas

sas2flash -list

LSI Corporation SAS2 Flash Utility
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved

    No LSI SAS adapters found! Limited Command Set Available!
    ERROR: Command Not allowed without an adapter!
    ERROR: Couldn't Create Command -list
    Exiting Program.

sas3flash -list

Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

    No Avago SAS adapters found! Limited Command Set Available!
    ERROR: Command Not allowed without an adapter!
    ERROR: Couldn't Create Command -list
    Exiting Program.

root@truenas[/mnt/MegaPool/Home_Share/Shado]#

5

Okay, so the model was different in your initial posts, but it makes more sense now.

If that card was running in RAID mode and if it has failed I am not sure how to recover without an getting an identical card.

Have you already tried booting to the old boot environment as instructed 2 months ago?

2 Likes
6

There is a lot of conflicting info out there but I don’t think that card can be set to IT mode or even cross flashed to IT mode. Since a straight RAID card would be incompatible (works until it don’t) with Truenas, the driver for that card may have been removed in the latest version of 25. So you might want to go back to the version of Truenas you had working with the card then make a decision on how to proceed from there.

4 Likes
7

I think ZFS just lost all my court related evidence.

I changed controller to 9300 and it see’s disks but the Pools are FUBARED.

I don’t know what to do as the data is so very important.

Main pool only reg 4 drives out of 20.

VMpool is gone 8 drives.

so that makes 22 drives failed because of update.

Any way to recover the pools???
I have tried everything I know which is non destructive.

8

controller was in JBOD mode.
IX systems told me they don’t have a solution so I went to get a ITMode SAS controller.

9

So it wasn’t the update that fubared the pools?

10

A hardware RAID controller in JBOD mode still is not in HBA mode. Depending on the firmware, it may or may not be able to have it’s JBOD disks moved to a HBA controller. This is because some hardware RAID controllers may reserve a block of the disk for RAID member info and the dirty stripe table. This is for re-syncing after disk replacement and to allow resuming part way through if a power outage occurs. Plus, re-assembling the RAID group on another, software compatible, hardware RAID controller.

Some hardware RAID controllers put the reserved data at the end of the disk. This helps make it easier to move a hardware RAID member disk to HBA controller. For example, one LSI IR hardware RAID controller used on Sun SPARC servers did this. Since the server was using ZFS and the hardware RAID mirror was borked, I was able to move the server to IT mode and use ZFS for mirroring.

However, this required many hours of research, as well as backups, both special recovery ones and normal backups.

Further, the LSI MegaRAID cards are more complex than the LSI IR RAID cards. Thus, not completely compatible.

Now, to useful information:

  1. Have you tried to boot the older version of TrueNAS with the original hardware RAID card?
  2. If the old card and old version of TrueNAS does not see the disks, you possibly have a failed card. Your best bet for data recovery is to find a similar LSI MegaRAID card and use that. Their will likely be special procedures to recover any LUNs, (which you call JBOD), but few of us here will know those procedures because we don’t use hardware RAID.

Last, RAID is not a backup. A NAS could be a backup, main storage, or both segregated. But, any data not backed up, is at risk.

1 Like
11

on 25.04.1 everything was working and has been so for years on previous versions from all the way back from 23.x
When I install upgrade from 25.04.1 to 25.04.2 the SAS stopped working. So yes the upgrade caused the issue.

I test the hardware as I have 2x LSI 9286-e pcie controllers.
and the issue remains. Yes you can flash these to JBOD mode with the right bios.

I reinstalled truenas with electric eel and it all works again. takes me days to re-setup everything(VMs apps and containers). Then I applied the new upgrade and it went down again. I rolled back and the sas still did not come back online.
So this is a driver issue in 25.04.2.x and above.

12

Did you Report a Bug and do you have a ticket to link here?

1 Like
13

…and you have experimental evidence that a MegaRAID 9286-8e is NOT the same as a HBA in IT mode, no matter what it may pretend.

2 Likes
14

It’s easier to just blame it all on everyone else.