I originally built my NAS with the topton N5105, and everything worked well. I was slowly upgrading the rest of my network to 10GbE, and wanted to get my NAS on 10GbE as well. I first tried one of the M.2 to 10Gbe cards, but the PCI lanes in that motherboard limited it to 3GbE and there was some instability with that card. So I decided to upgrade the board to the topton N18. Similar motherboard, but with n100 processor, DDR5 memory, and integrates 10GbE port.
Easy swap out, and only had to make network adjustments to TrueNAS to get it back up. Running iperf shows me I’m getting nearly full 10GbE speeds between my proxmox nodes and TrueNAS. Woohoo!
Now the problem. Since this change, any of my self hosted containers that utilize NFS shares from TrueNAS have been painfully slow. For example, in a qbittorrent, if I download an Ubuntu iso where there are a ton of seeders I get vastly different speeds when saving locally vs directly to the NFS share. Locally I’ll see 40+Mbps, and about 200Kbps when downloaded to the NFS share. I was getting much faster speeds on the old motherboard. Also if I have any of these slow torrent downloads going, I cannot stream a 4k movie locally to my TV (TV is ethernet connected). It constantly buffers. If I stop all downloads, the movie plays fine.
I’ve been going nuts trying to figure this out. I’ve done network testing, reinstalled TrueNAS and imported my config, moved the qbittorrent container to another node, created a new qbittorrent container, created a new NFS share on an SSD pool, and more. I believe I have it narrowed down to either an NFS performance issue, or a read/write issue within TrueNAS. Although if I rsync a large file between pools on the NAS it is very fast.
Do you have any ideas on how I could troubleshoot this? I went through the BIOs to see if there was anything there that seemed off, but found nothing. I also recently upgraded to Electric Eel. Could that be causing an issue?
Unless others have a suggestion, my next steps will be:
- swap back in old motherboard and test.
- switch back to new motherboard. Do a reinstall of truenas, but instead of importing my config, reconfigure from the ground up. Import pools, recreate networking and services.