M1015 in IT mode not working after update to 25.04. fangtooth

TrueNAS General
,
1

Heya fellow humans,

TL:DR. After updating from 24.04 to 25.04 my 2x2 striped mirror pool attached to a M1015 in IT mode dissapeared.

Long story:
Today I made the update from 24.04. to 25.04. because I need the switch from Kubernetes to docker and a few other new features.

Update went fine and everything booted…except my M1015. It is still there looking for it with “lspci | grep -i sas”

But it does not show the disks attached to it anymore. I checked with ls /dev/disk/by-id in shell and none of the 4 2TB SSDs show up.

So naturally I booted back into 24.04, and voilá…everything back up and running. On 24.04. it’s using mpt3sas driver 43.100.00.00 and I also checked what’s grabbing PCI resources on bootup on both versions and it’s looking fine.

Then I checked mpt3sas driver version and saw 25.04 is using mpt3sas 48.100.00.00.

I anyone else having troubles with this driver? My HBA is confirmed in IT mode running firmware 20.00.07.00

I’m a bit at a loss here. I don’t want to force the 43.100.00.00 mpt3sas driver into 25.04.

Any insight or help is highly appreciated.

2 Likes
2

Well, probably not much help, only that it might be something else.

I have two systems, one with a M1015 in IT mode, the other with a card with the same chip, and both work fine with after updating from 24.10. to 25.04. Both use the 48.100.00.00 driver, I verified that.

1 Like
3

Well, that is good info. Thanks.
What firmware are you running on the M1015, if I may ask?

4

As you’re confident the hardware is fine and on proper firmware, file a bug report with iX.

The switch do docker was already in 24.10. Maybe you could have updated in steps? 24.04 → 24.10 → 25.04 (the latter being optional at this .0 stage)

5

image

1 Like
6

Yeah, I rolled everything back and updated to 24.10. this morning. Same result.

FW version and BIOS is also the same as prez02.

I have to say I bought the HBA card already crossflashed in IT mode.

So I may have to flash it again myself to be absolutely sure it’s working as expected and not a hardware issue.

Thanks heaps for all the replys and help. I will tinker a bit more with it.

7

Ok…for the sake of completness.

After reading somewhere here on the forum that the old SAS2008 drivers are not supported in the kernel that’s used in 25.04 fangtooth, I got myself a nice used DELL HBA330.

Put it in…and I still get the same error. So I dug into it a little deeper and found the mpt3sas did not get proper memory allocation and couldn’t be bound to the HBA.

[    1.719475] mpt3sas version 48.100.00.00 loaded
[    1.719736] mpt3sas 0000:06:00.0: BAR 1: can't reserve [mem 0xe1200000-0xe120ffff 64bit]
[    1.720284] mpt3sas_cm0: pci_request_selected_regions: failed
[    1.734845] mpt3sas_cm0: failure at drivers/scsi/mpt3sas/mpt3sas_scsih.c:12386/_scsih_probe()!

So I set a few “kernel arguments” with midclt…these were:
pci=realloc=off
intel_iommu=on
iommu=pt

And now it’s working flawlessly. The mpt3sas driver is propery bound to the HBA and everything is working as it should.

So…I think the purchase of the HBA330 was unneccessary, but now I at least have a SAS3008, which is also a bit faster than the M1015.

I might put the old M1015 in just to see if the “kernel arguments” fix it for that HBA as well.

2 Likes
8

I am sure that will be helpful to someone in the future. Would you mind sharing you hardware a bit more apart from the HBAs?

9

Yes, sure:

MoBo: Supermicro X9SRI-F
CPU: Xeon E5-2650v1
RAM: 64GB ECC DDRR
Case: SuperChassis 833TQC-653B with the 8 port BPN-SAS3-833A backplane

And it’s running a baremetal TrueNAS Scale 25.04. as my NAS.

Most of the drives are connected to the onboard SATA plugs, but the four SSDs mentioned above are on the Dell HBA330 now.

1 Like