i have a single melonix 40gb dual port card and i am not getting 40gb speeds. i have the switch set up as a lag on both 40 gb ports. I need to know how to set up truenas scale 25.10.1 to force the card to go 40gb speeds per port.
Thanks
Shawn
Details on the model of the card and your system hardware may help with answers. Were you able to hit 40 Gbps using a single port when testing? Do you have the card in the correct type of slot?
I use Mellanox ConnectX-3 40G dual ports. You will need to check, and see if you have the latest firmware installed on the cards and ensure they are in ETH mode, PCI-E 3.0 x8, set jumbo packets to 9000. I don’t believe RoCE is enabled in TrueNAS Scale, but it is enabled in Core, so you won’t be able to hit the full 40 Gbps speeds. Best I’ve managed in Scale is around 25.6 Gbps over DAC.
In Windows, you will need to check the adapter properties and ensure you’ve established 40 Gbps duplex.
X7DB8 motherboard model
cx354a nic card model #
Did you solve the other problem? The two might be related and I wouldn’t worry about performance before the other.
do you know a way to flash the new firmware on the cx354a from truenas using ethtool
i have the new firmware file downloaded allready
Maybe this is it? Otherwise there may be Windows tools and you would put the card in a Windows machine and flash.
2 Likes
Yes, easiest way is to flash in windows. You can do it in Linux if you are comfortable with terminal. You can also set ETH mode in the tool; same with Linux terminal.