Replication Task Speed

TrueNAS General
1

Greetings
After switching to TrueNAS SCALE Single Replication Task Can’t saturate 10Gb Link but if I start Tow replication Tasks I can easily saturate 10Gb. Is there a way to improve replication task speed. I thought of Auto Tune since I’m coming from TrueNAS Core but I can’t seems to enable it “Scale is discouraging it”. Both servers are Dual AMD EPYC 7C13 64-Core Processor with 256GB RAM 24x22TB HGST & 25Gb NIC but switch extreme 10Gb
Thanks in advance

2

Yes, each task is limited by a single TCP connection and is largely single threaded.

You’ll only be using a single core of your 64 core processor.

To get max bandwidth, you need parallelism… more replication tasks.

1 Like
3

If you’re within a trusted network have you tried NETCAT to improve performance?

1 Like
4

But in Core I was able to saturate even with Intel xeon E5-2673V4 20 core
do you think reverting back to Core will help
notice I’m replicating a Total of 170TB of Data hence 10Gb is much better than 6Gb

5

I’m new to This what NETCAT will do

6

SSH + Netcat is the faster option

Netcat act as a faster pipe.

1 Like
7

I know it might be too much to ask but I couldn’t locate any material on TrueNAS Scale & NC on Youtube. If you can share a screen for TrueNAS as a Push or Pull configuration & what I should do from the other end. I generated an SSH key between both systems since I can use Replication Task as a Wizard obviously.

Thanks in advance

8

Hi Jacoub,

In the Replication Tasks advanced settings UI, you can select a transport protocol from SSH, SSH+NETCAT, and LOCAL. Someone said SSH+NETCAT could speed up the replication task, but I don’t think so. In my practice with TrueNAS SCALE, there is no obvious performance difference. However, I suggest you try it.

  • With NETCAT, you can not set stream compression.
  • You’d better to install netcat command on both two machines.
1 Like