Hi everyone,
I am experiencing an issue with NFSv4. I have joined Truenas to a Kerberos realm and enabled the IPA integration. The state is healthy. A client can mount NFS and Samba shares both. Both server and client are connected with a 40GBits line that was tested with iperf3.
The usage of Samba is as expected, about 10-20% CPU usage with encryption setting set to required.
ZFS sync: standard; SMB; Encryption required: 14% CPU, 833MB/s
It is a completely different story with NFS however.
ZFS sync: disabled; KRB5; 87%CPU; 1.5GB/s
ZFS sync: standard; KRB5; 92%CPU; 714MB/s
ZFS sync: standard; KRB5P; 97%CPU; 625MB/s
This setup currently runs in a VM, to even get these speeds with NFS I needed to provide the VM with 8cores/16threads, which is insane. With 4cores/8threads I am getting reduced speeds of only up to ~440MB/s.
I SSH’ed into the machine to see if there is any misconfiguration in the NFS server but apparently the exports and everything else does not get configures in files but apparently is managed by Truenas in some sort of database.
I’d like to know if there is anything I can do to bring down the CPU usage before the final deployment. One single NFS share hogging the entire CPU or being speed limited does seem unintentional to me.
Thank you!