@Arwen I have a Raid Z1 set up and I’m getting these results, I have 4x NVME Raid Z1 with one VDEV over 100GBE link.
I have read that because I only have 1 VDEV this is throttling the connection to the speed of 1 NVME which looks about right. Any Ideas on how to get more performance? Am I right in thinking if I had 6 drives split into 2 RaidZ1s and then create the pool with the 2 VEDEVs this would double the performance?
Whenever you are looking for performance, you want striped mirrors, not RAIDZ vdevs.
Here’s what Matthew Ahrens (ZFS co-founder) has to say on the subject:
For best performance on random IOPS, use a small number of disks in each RAID-Z group. E.g, 3-wide RAIDZ1, 6-wide RAIDZ2, or 9-wide RAIDZ3 (all of which use a…" of total storage for parity, in the ideal case of using large blocks). This is because RAID-Z spreads each logical block across all the devices (similar to RAID-3, in contrast with RAID-4/5/6). For even better performance, consider using mirroring.
So mirror 6 drives into 3 vedevs? and create pool from them
3 mirror vdev’s yes.
My Max NVME count is 9 so with pool size in mind v Performance 3 raid Z1 vedevs is probably my sweet spot. Thanks for your help!
