Hello, I recently purchased a pair of Mellanox ConnectX-3 cards and a DAC cable to establish a dedicated 10Gbps connection between my main Windows 11 PC and my TrueNAS server. Both machines are connected to my regular network as well via ethernet.
My main network is 192.168.1.0/24 and for the Mellanox cards I set the TrueNAS to static at 172.16.0.1/16 and my Windows 11 PC to 172.16.0.2/16.
I am unable to ping TrueNAS from my Windows PC at 172.16.0.1. When I restarted my Win PC and it came back up, the TrueNAS box indicated “mlx4_en: mlxen0: Link Up” and it shows as up in the WebGUI as well. Windows shows the link as active, but it only shows sent packets and none recieved.
Below is the output of on the TrueNAS machine. Does anyone have ideas on why I am unable to ping or connect over the second direct connection?
Blockquote
root@truenas[~]# ifconfig
em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=481249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER,NOMAP>
ether 08:62:66:81:13:16
media: Ethernet autoselect
status: no carrier
nd6 options=9<PERFORMNUD,IFDISABLED>
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
ether 08:62:66:81:16:fe
inet 192.168.1.41 netmask 0xffffff00 broadcast 192.168.1.255
media: Ethernet autoselect (1000baseT )
status: active
nd6 options=9<PERFORMNUD,IFDISABLED>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
inet 127.0.0.1 netmask 0xff000000
groups: lo
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
pflog0: flags=0<> metric 0 mtu 33160
groups: pflog
mlxen0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=ed07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINK
Blockquote