Incredibly slow 10 Gig downloads to TrueNAS Scale - internal transfers/docker containers are fine

TrueNAS General
,
1

I finally upgraded my Internet connection to fiber and was testing transfer speeds, and am hitting a very strange bottleneck when testing a download via wget/curl directly to my TrueNAS Scale 24.10 system where it tops out at around 88Kb/s (yes, Kb/s).

The system is cabled via 10GB SFP+ NIC to my managed switch, which is connected to the rest of the network and the router via 10GB fiber. Transfers to and from the server over SMB/SFTP are plenty fast, and docker containers running under Dockge on the system don’t seem to have any limitations. However, a direct download to the server via wget/curl from the command line tops out at 88Kb/sec. For reference, I’m testing with:

curl -O https://ash-speed.hetzner.com/10GB.bin

The performance on this same test meets bandwidth expectations on other systems on the network, but downloading to my TrueNAS Scale server just hits a weird low limit. I also ran iPerf from this machine to another server and didn’t see any limitations. No other transfers taking place on the system concurrently, so I’m not sure what’s the issue here.

I’ve reviewed this post and the 10-Gig Networking Primer, but nothing there seems to explain the slow curl speeds while other types of transfers to/from the same system seem to be happy and snappy.

Any ideas as to what I might poke at to remove the bottleneck?

2

Also noting that this download bottleneck seems to apply to pulling updates for Docker containers, but not to the applications running inside the containers. Stumped.

3

I am noticing slow download speeds on docker containers too (pulling images). I have noticed this on 24.10x and now on 25.04 with same results.

1 Like
4

I can also confirm that downloading updates on the 24.10.x release is incredibly slow (200KB/s max).
This is from New Zealand but not experiencing anything like this on the rest of the network.

5

I’m also seeing TrueNAS updates coming down at about 680Kb/s on my 3gbps line. Is this perhaps a driver issue? The speed limits only seem to be curl from the TrueNAS command line downloading TrueNAS updates, pulling Docker images… all other instances running on the system seem uninhibited. FYI I’m running an Intel X540-T2 dual 10gbe NIC card with both ports running connected at 10gbe and a bridge created across both ports. Same issues with single or dual ports in the bridge, and with a 10Gtek SFP+ adapter card as well.

6

Have been using a datacenter closer to myself and i’ve just got 500 MBit downstream but speed seems to be reasonable:

root@truenas[/mnt/nvme2]# curl -O https://fsn1-speed.hetzner.com/10GB.bin

% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
10 10.0G 10 1102M 0 0 57.3M 0 0:02:58 0:00:19 0:02:39 55.8M

Link speed for the interface which is used for downloading was 1gig not 10 gig tho. And i am on 25.10.