HBA passthrough

If network speed isn’t affected, I’d check if your pcie slot is supplying the full amount of lanes to the HBA. You didn’t plug it into an x1 slot or something by chance?

Though I mean, even pcie 1.0 x1 should be capable of more than that…

You can check by first using lspci | grep -P "LSI" & then find the LSI card:

2d:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
Subsystem: Broadcom / LSI 9211-8i

Then see the stupid numbers/letters at the start (2d:00.0)? Using yours you’d do something like lspci -vv -s 2d:00.0 Change the 2d:00.0 to whatever yours is mapped to. You’ll get a BUNCH of info on the card. Somewhere in there, you’ll see something along the lines of:

           LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM L0s, Exit Latency L0s <64ns
                    ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
            LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
                    ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
            LnkSta: Speed 5GT/s, Width x8

That should tell you the supported max speeds (5GT/s in my case) and the current speeds & Pcie width (5GT/s, Width x8 - in my case).

If nothing is too different from your card’s reporting vs mine, then the following (After you identify & change ‘2d:00.0’ to whatever your card is mapped to) should output the needful

lspci -vv -s 2d:00.0 | grep "LnkSta:"

which for me outputs:

pcilib: sysfs_read_vpd: read failed: No such device
                LnkSta: Speed 5GT/s, Width x8   <-------------

…If you are getting the right amount of lanes at the correct speeds - no clue. Someone smarter will have to guess.

1 Like

I tinkered with the HBA all night trying to figure this out and I might have ended up breaking it since it’s not recognized by my server anymore, nor is it recognized by any of my other systems for that matter. I did do some troubleshooting before that happened, such as running this command on TrueNAS:

dd if=/dev/zero of=/mnt/pve/testfile bs=1M count=1024 oflag=direct

which outputted:

1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.193836 s, 5.5 GB/s

Then I tried changing the PCIe slot used but that resulted in interfering with other connections, such as the ethernet port. Shortly after, the HBA stopped working altogether so I gave up and reverted everything back to the way it was when all the drives were plugged directly into the motherboard.
I am still open for suggestions if I eventually try my luck again.