Hi,
Just built a server based on an ASRock Rack GNRD8-2L2T and Xeon 6511P, running CE 25.10.2.1.
I’m bumping into an issue where if I power down the system and install a Mellanox ConnectX-3, the system gets stuck at “Loading initial ramdisk…” and can’t boot. I’ve ruled out the individual card by swapping in a second I have laying about.
Weirdly enough, the ConnectX-2 also installed in the system works perfectly fine without complaint.
Any suggestions?
TIA!
Replace with ConnectX-4 or a newer card.
I preface this by saying that I have no idea what the issue is, just thinking about what I would be trying.
A quick search showed that there seem to be some issues with the X-3 in some Kernels. 6.12 should be working though and this is what is used by 25.x AFAIK. Have you checked if the cards are in ETH mode or if there are updates for the firmware available you could try?
I don’t know this board but it might be worth checking if they are even recognised in UEFI correctly and what the PCIe Settings are.
Maybe someone else has experience with those.
Been using my connectx-3 with truenas scale for over 4 years without any issues, regardless of which version i was using.
I knew there would have to be someone using the same card in here.
Maybe it is a board or CPU issue then. Do you have any pointers for OP? Did you have to change anything or install drivers manually? UEFI Settings? Anything that would explain two different X-3s not working in their machine?
Just a wild guess, i remember vaguely that i had to use a windows machine and change the cards i use from infiniband to ethernet mode, but i can’t remember if my system wasn’t booting with the cards in IB or if the cards simply didn’t show up when the system was booted
Well, I slung the cards into some other Debian systems and they did Ethernet just fine with no reconfiguration necessary… /shrug
I think I’ll just get some newer cards TBH
