TrueNAS is not detecting mellanox connectx-5 100G card

I have PCIe Mellanox Connectx-5 100G network card [https://www.fs.com/products/119647.html?attribute=67743&id=3746410] on Dell R730xd server
the dell server is not able to detect the network card but the switch shows it is connected and i see light on the card showing connection is established from the switch

truenas scale is also not seeing the card at all

is there anything i need to do to make truenas detect this network card?

I am running TrueNAS SCALE Dragonfish-24.04.2.3

in the screenshot below the only interfaces detected are the onboard network card

image

Check If the card is set to infiniband and not Ethernet mode.

1 Like

how do i check that? can i do that while it is connected to truenas? else will be a task as i will have to remove it card and insert into another server to do that

Easies way would be to connect the card to a windows pc and use the melanox windows tool to check it, and if it’s in infiniband mode set it to ethernet, then connect it to the truenas box again.

Do you have both CPU sockets populated in your R730xd? If not, ensure that your card is installed in a PCIe slot mapped to the first CPU.

The output of lspci may also be useful here, but if your card is not recognized on the hardware level (UEFI/BIOS) as either a network or storage adapter then this suggests a problem somewhere else.

1 Like

https://enterprise-support.nvidia.com/s/article/howto-change-port-type-in-mellanox-connectx-3-adapter

you could try the steps from this guide for the connectx-3, it should be similar for the connectx-5

actually this might be it, i only have 1 CPU connected, and i did not check to make sure the slot was for the 1 CPU
will try to add second CPU and test it out
hope this is the issue

thanks for pointing this out

That’ll be it then, by default you only get Slot#5 on Riser 2 and anything in Riser 3 for the first processor.

https://www.dell.com/support/manuals/en-us/poweredge-r730/r730_ompublication/expansion-card-installation-guidelines?guid=guid-48fdcedc-e689-4cb6-a83c-7b9ea4e31449&lang=en-us

so which one is riser 3 that i can move the card to?
below image shows slots 1,2,3,4,5,6

currently the card is in slot 1
so where do i move it to to know it is for 1 CPU?

Slot#5 or Slot#6 in your photo will be allocated to the first CPU socket.

1 Like

ok great, will move the card to slot 5 and see what happens

thanks

1 Like

kept the card in slot 1 and just added second CPU and now can see the card

thanks again @HoneyBadger

1 Like