Good day Fellow Community. I wish to ask for some advice in regards to Incorporation of Truenas Scale to XCP and using NFS Shares as our Primary Storage for VMs.
TrueNAS Server: Scale Dragonfish 24.04.2
Dell R630
2 CPU’s
128GB of RAM
Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
Disk are setup with ZFS File Systems
vDEVs are configured as Raid10 2x Mirror & 2 wide. thus One Mirror per Drive.
My logVDEV is 2 Intel Optane NVMe drives Set to Mirror Accross to another Intel Optane NVMe (P4800 375GB Series)
https://ark.intel.com/content/www/us/en/ark/products/97162/intel-optane-ssd-dc-p4800x-series-375gb-1-2-height-pcie-x4-3d-xpoint.html
Each owning a Data Set for NFS Shares and iscsi.
Essencially using our NFS share for VM Hosting from XCP Host
Network:
Intel 10GB Network Cards and Onboard Fibre Port used in a Link aggregation with LACP as the Protocol of Choice, providing a redudancy to the network for heavy traffice between NFS share Hosting Truenas and XCP VMs, Using DAC cables as our prefered communication. LACP had been Configured on all Hosted NICs, All Network Switches and confirmed to be in working order.
A Little More Detail from My Hypervisor/ XCP.
Dell R820
CPU 4 Intel Xeon E5 465 wit ha 2.40GHz processing at 2400MHz
RAM 1TiB
Now we had done prior test on Network Shares and the traffic with a smaller subset of VMs and had seen a slight delay on perfomance from the Local Storage, which is expected with extra TCP/UDP Packing that has to occure on the requested Packets.
Within the first registration of our Hosted VMS on the new NFS Shares we noticed that there is the expected delay, however one of our Server was much higher on our resource consumtion than expected, this is a Linux VM being used as a VOIP server.
Within our 3rd week of Starting VMs up on their new NFS Shares we noticed a MS Server is being massively affected, two Windows servers which make use of MS SQL have their apps on the server slow down tremendiously.
When we do active Delta and CR replications are set to run the jobs shoot up the load of the host to an average of 5 to 7 during the process
Here is some Attachements from What i could see occure on True Nas During the stage of Moving the Data away from the NFS share to a Local Drive. Might Appear that the Network Traffic it self is being Throttled, as the host XCP is not utilizing the full extend of its network
10GB NET
Host Share Network
XCP Stats
Is there a recommended method for creating and adding the network share to XOA?
I am Planning on creating a Lab Environment during this Week to test the VMS as clones on their OWN isolated Environment. Using Both NFS V4.1 & 4.2 as Standard Shares. Any advise or recommendations for the lab environment to look at. One Being a Duplicate of what we are currently Experiencing and testing different Protocols or methods on another.
Any insight or advice would be welcome!