Setting jumbo frames on windows 11 and on truenas scale to 9000 on both results in smb and iscsi share to become unreachable. But truenas scale ui still reachable as well as all apps. Direct connection over sfp+ fiber at 10gb what to do to diagnose.
Windows must be 9014 not 9000
hmm yes windows is at 9014. 9000 is not even option. i’ve even tried setting the jumbo frames on trunas to 9014 as well and no change. tried 4088 on windows to
Run iperf3 test over connection with Jumbo frames to test that it works
good news i got jumbo frames to work.
[ 4] 9.00-10.00 sec 520 MBytes 4.36 Gbits/sec
[ 6] 9.00-10.00 sec 520 MBytes 4.36 Gbits/sec
[SUM] 9.00-10.00 sec 1.02 GBytes 8.73 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 3.93 GBytes 3.37 Gbits/sec sender
[ 4] 0.00-10.00 sec 3.93 GBytes 3.37 Gbits/sec receiver
[ 6] 0.00-10.00 sec 3.95 GBytes 3.40 Gbits/sec sender
[ 6] 0.00-10.00 sec 3.95 GBytes 3.40 Gbits/sec receiver
[SUM] 0.00-10.00 sec 7.88 GBytes 6.77 Gbits/sec sender
[SUM] 0.00-10.00 sec 7.88 GBytes 6.77 Gbits/sec receiver
bad news my iscsi share is no were to be found 
This is telling me it is windows or hardware related on my windows machine. As other devises or able to connect to truenas scale im suspecting network card grrrrr as the windows connection to SMB seems to be very unstable. Off to buy another intel nic off of ebay again. FML. Why didnt i just buy to of these “HP NC560SFP+ 669279-001 10GB DP SFP+” in the first place
Buy Mellanox ConnectX 4-lx and call it a day
erm 25 gb network card on 10 gb infrastructure a little over kill don’t you think.
Im looking at this card its a 10 gb and it will work with my existing network hardware. i don’t normally have my PC daisy chained to Truenas server.
normal is gateway to switch Truenas to switch PC to switch. gateway and switch are both 10gb and capable of jumble frames at 9000 (There are other devises also connected to switch. not shown) PC was connected direct to Truenas to eliminate the Switch for testing.
If you share what the issue was and how you solved it, someone else may benefit from that information down the road.
well this is the card in the windows machine. it does not work in truenas scale will not get detected at all. I’ve tried hens the hp network card in truenas scale. i have a reasonable suspicion that this card is a knock off card. whats funny is everything else works it does 10 gb but as soon as you turn on jumbo frames it craps itself. ohh and its no longer available. i wonder why…
1 Like
i’ve orderd the card i was looking at and ill update when it arrives.
that card you ordered is junk, sorry for you
connect4x lx is just $10 more and much better chipset
its still over kill. if im going to go faster than 10 gb im going all they way to 100 gb/s and 10 gb intel nics are also dirt cheap to.
Card has arrived and it works. Turning jumbo frames on at windows machine to 9014 still does not work…
Why, well i have truenas network ports set up in bridge mode for apps. I have the bridge jumbo frames set to 9000 witch works for truenas UI but for some reason you can set the jumbo frames on the other interfaces still. Setting that to 9000 fixed it.
My truenas has network interfaces bridged.
IP address is managed by gateway/router
Working setup/THE FIX
Bridge interface jumbo frames set to 9000
10GB nic interface jumbo frames set to 9000
Having interfaces jumbo frames set to 1500/default results in non functional SMB/NFS/ISCSI shares. Apps are still reachable
as soon as you set jumbo frames on 10GB interface to 9000 it works
To use jumbo frames in bridge config, everything must be set to use jumbo frames
I suspect that this was my problem here. For why you need to set it on both and not just the bridge, is a question of WHY?
thats how it works
Fragmentation of larger packets is why. A well known requirement of Jumbo Frames is that every device on the network needs to have it enabled.
Blockquote A well known requirement of Jumbo Frames is that every device on the network needs to have it enabled.
so then if i have my network devices all in a bridge and theirs a MTU setting in the bridge devise. Whats the Point of Having it also in the individual network devises that make up the bridge device. wouldn’t having the setting in one place only make more sence
All network adapators need to be able to support and be correctly configured for Jumbo Frames irrespective where they are on a given network.