Slow speed from TrueNAS to Hosts

TrueNAS General
, ,
1

Hey everyone. I have TrueNAS 25.10.2.1 - Goldeye deployed on a Proxmox VM.

Network interface is set to virtio and I am getting slow SMB speed when copying from a TrueNAS share to any host. But I am getting full speed when copying to a TrueNAS share from any host. I have a 2.5Gb network.

I have 2 pools and the speeds are consistant on either pool.

Here is some info:

truenas_admin@truenas[~]$ iperf3 -s
-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 10.10.10.66, port 58157
[  5] local 10.10.10.101 port 5201 connected to 10.10.10.66 port 58158
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   257 MBytes  2.16 Gbits/sec
[  5]   1.00-2.00   sec   265 MBytes  2.22 Gbits/sec
[  5]   2.00-3.00   sec   269 MBytes  2.26 Gbits/sec
[  5]   3.00-4.00   sec   262 MBytes  2.19 Gbits/sec
[  5]   4.00-5.00   sec   267 MBytes  2.24 Gbits/sec
[  5]   5.00-6.00   sec   265 MBytes  2.22 Gbits/sec
[  5]   6.00-7.00   sec   262 MBytes  2.20 Gbits/sec
[  5]   7.00-8.00   sec   262 MBytes  2.20 Gbits/sec
[  5]   8.00-9.00   sec   265 MBytes  2.22 Gbits/sec
[  5]   9.00-10.00  sec   262 MBytes  2.19 Gbits/sec
[  5]  10.00-10.02  sec  4.12 MBytes  2.11 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.02  sec  2.58 GBytes  2.21 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201 (test #2)
-----------------------------------------------------------
^Ciperf3: interrupt - the server has terminated
truenas_admin@truenas[~]$ iperf3 -c 10.10.10.66
Connecting to host 10.10.10.66, port 5201
[  5] local 10.10.10.101 port 43698 connected to 10.10.10.66 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   139 MBytes  1.17 Gbits/sec    0    271 KBytes
[  5]   1.00-2.00   sec   142 MBytes  1.19 Gbits/sec    0    271 KBytes
[  5]   2.00-3.00   sec   142 MBytes  1.19 Gbits/sec    0    271 KBytes
[  5]   3.00-4.00   sec   141 MBytes  1.19 Gbits/sec    0    271 KBytes
[  5]   4.00-5.00   sec   142 MBytes  1.19 Gbits/sec    0    271 KBytes
[  5]   5.00-6.00   sec   143 MBytes  1.20 Gbits/sec    0    271 KBytes
[  5]   6.00-7.00   sec   143 MBytes  1.20 Gbits/sec    0    271 KBytes
[  5]   7.00-8.00   sec   142 MBytes  1.19 Gbits/sec    0    271 KBytes
[  5]   8.00-9.00   sec   139 MBytes  1.17 Gbits/sec    0    271 KBytes
[  5]   9.00-10.00  sec   140 MBytes  1.18 Gbits/sec    0    271 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.38 GBytes  1.19 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  1.38 GBytes  1.18 Gbits/sec                  receiver

iperf Done.
truenas_admin@truenas[~]$ ethtool -i enp6s18
driver: virtio_net
version: 1.0.0
firmware-version:
expansion-rom-version:
bus-info: 0000:06:12.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no
truenas_admin@truenas[~]$ ethtool enp6s18
Settings for enp6s18:
        Supported ports: [  ]
        Supported link modes:   Not reported
        Supported pause frame use: No
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  Not reported
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: Unknown!
        Duplex: Unknown! (255)
        Auto-negotiation: off
        Port: Other
        PHYAD: 0
        Transceiver: internal
netlink error: Operation not permitted
        Link detected: yes

I have tried using vmxnet3 network with similar results. I have tried different SMB settings with the same results.

The network speeds were working fine on version 24.10.

I cannot passthrough the network card as it is being used by other Proxmox VM’s. Even with the other Proxmox VM’s off the network is still the same.

Any insight to this issue?

2

System specs?

How much ram / CPU?

How are your drives configured?

What does resources usage show when copying files TO TrueNAS, any high CPU usage spikes/maxing out?

What settings do you have on your SMB share, sync writes and all that?

What types of files are you moving, lots of small files or larger files?

3

Here are the specs on the Proxmox host for the TrueNAS VM. The HBA is passed through.

image
image678×258 12.1 KB

Proxmox CPU is Intel i5-12500H.

Pools are:

Apps = 1 vdev with single SSD disk.
Data = 1 vdev with 5 HDD in RAIDZ1.

SMB settings are set to Default Share. SMB1 and NTLM1 are turned off.

When copying to the TrueNAS on either share the CPU does spike to about 25% usage while maintaining the 2.5Gb network speed.

When copying from the TrueNAS on either share the network transfer is around 120-130MB/s. With CPU usage around 2-5%.
Network speed is confirmed in my iperf3 output from the first post.

I do have Syncthing installed and it is used to sync my PC files. I also have Immich and Nextcloud installed and working fine.

I have a mix of large and small files. For my testing I was using a 5GB ISO file.

This is not a drive/cpu/share issue. It looks like a networking issue on TrueNAS 25. As when I had 24 on there the networking was working at full speeds.

4

I have resolved the error.
It was due to Proxmox’s internal switching (maybe a throughput issue). Moving Truenas to a NIC connected directly on a 2.5Gb switch resolved the issue.

3 Likes