OK, I’ve reverted to 25.04 because of this post: 25.10 drive performance has dropped significantly
I’m trying to make sure I have the right “tools” and understanding to evaluate performance and other appropriate settings.
This is the “basic” format of my FIO test. My previous post, I have a script with runs through RanW, SeqW, RanR and SeqR.
sudo sync;fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test_rand_write --filename=test_rand_write --numjobs=32 --bs=4k --iodepth=256 --size=200M --readwrite=randwrite --ramp_time=4 --group_reporting
Testing with a single device pool with a 500 GB SSD (using above), directly on Truenas system
Random write: 1092 MB/s, IOPS: 27,9650
However, from remote VM (with 2.5 Gb/s link), with NFS share and using the same command as above,
Random write: 11.5 MB/s, IOPS: 2,953
I’m not understanding the 95% drop in performance due to “NFS and 2.5 GbE link” interconnect.
So, questions:
- Am I running a “resonable” test FIO to evaluate?
- Why the 95% reduction in BW between server and VM (i.e. 2.5 GbE should produce 250 MB/s throughput)
My Truenas system:
MB: X11SPH-nCTPF (built in SATA and 2 10G SFP+), BIOS version 4.7, FIRMWARE version 1.74.17. Processor: Intel Xeon 3204 (6 core 1.9 GHz typ)
Memory: 32 GB