Slow network transfer speeds on Gen8 HP Microserver

I reviewed a previous thread on the old forums (“Write Performance Issues with Scale 22.02 on HP Microserver Gen 8”) and I am having similar issues under 24.10

I have a similar setup as the original poster, with the following differences:
CPU: I am using a Xeon E3 1265L V2
4 x 4Tb Seagate drives in a single pool as RAIDZ1

Likewise nothing running, both NICs connected to my switch/router but not bonded or anything (that’s beyond my knowledge right now). As I am in the process of bulk transferring data across to this server, it is currently connected to a router that is acting only as a switch and DHCP server - no internet access.

As I don’t have access to an alternative card to take the HBA backplane input, I have to pass this through the motherboard. I am running the board in AHCI mode I believe (either than or legacy), with the boot controller order reversed to allow TrueNAS to boot directly from an SSD connected to the internal ODD Sata port - I’m not using a workaround with GRUB on removable media, as the system seems to be working without this.

I haven’t checked the Drive Write Cache mentioned in the thread - that will be my next option - but failing that, is there any other possible thing that might be causing the bulk transfer of data onto the server to start around 100MB/s to then drop to a sustained write of ~12MB/s?

Here is a direct link, you are probably not allowed to post it, yet.

What happens if you remove one the connections? I do not think just plugging them in will work, you’ll need to set this up in the switch and truenas itself (or is one of them the iLO-port?).

I went into the BIOS and enabled the drive write cache (as suggested in the original thread) and that appears to have resolved it.

As far as having both NICs connected, it doesn’t seem to be causing any issues. The idea initially was to allow me to copy files from two machines onto the NAS, given that the network is more of a bottleneck than the drive write speeds should be - but sadly that hasn’t worked. I have considered using another router to connect the secondary PC to the NAS, but I figure it’s not worth the hassle

To use two NICs, place them on different subnets and give the secondary PC a static IP address on the “secondary subnet”.

I’ve got them both hooked up through one router with DHCP. Router default is a 10.0.0.xxx address, where my primary home network is a 192.168.0.xxx address, so no conflicts there - but my main PC is the only one connecting to both. The NICS are both showing up in TrueNAS, with IPs of 10.0.0.16 & 10.0.0.17. iLO is connected through NIC1, but with a separate IP of 10.0.0.19.

Are you saying that I should manually configure NIC2 in order to get it to have a separate connection?

Yes. For example, manually assign the IP of one of the two NICs to 10.0.1.1 and your secondary pc to 10.0.1.2. and cable them directly.