I am running 20Gb (10Gb x2) connection with some (distant) plans to upgrade to 56Gb, but I think it will require disk array upgrade as well. Besides TrueNAS I have Proxmox running on the same server and using ZFS natively for VM volumes + a few other Proxmox servers accessing NAS through iSCSI and NFS + a few clients with a little occasional SMB workload. I also have pretty loaded PostgreSQL running on the TrueNAS machine.
Just tested with the second wire connected to the extension controller mode and got ~4-8% performance improvement (~1.3GB/s), which most likely is just a fluctuation.
It’s a homelab (used for my business needs though), so pushing everything to the limet is still fun even when there is no real need.
It seems that the controller see the disks trough different paths…
anyone can tell me what is the proper action to avoid this ?
root@NSA[~]# sas3ircu 0 display
Avago Technologies SAS3 IR Configuration Utility.
Version 16.00.00.00 (2017.04.26)
Copyright (c) 2009-2017 Avago Technologies. All rights reserved.
Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
Controller type : SAS3008
BIOS version : 8.37.00.00
Firmware version : 16.00.10.00
Channel description : 1 Serial Attached SCSI
Initiator ID : 0
Maximum physical devices : 1023
Concurrent commands supported : 9856
Slot : 1
Segment : 0
Bus : 25
Device : 0
Function : 0
RAID Support : No
------------------------------------------------------------------------
IR Volume information
------------------------------------------------------------------------
------------------------------------------------------------------------
Physical device information
------------------------------------------------------------------------
Initiator at ID #0
Device is a Hard disk
Enclosure # : 2
Slot # : 0
SAS Address : 5000cca-0-bc3c-292d
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22NZG
Unit Serial No(VPD) : V1H22NZG
GUID : 5000cca0bc3c292c
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 1
SAS Address : 5000cca-0-bc3c-2665
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22H7G
Unit Serial No(VPD) : V1H22H7G
GUID : 5000cca0bc3c2664
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 2
SAS Address : 5000cca-0-bc3c-2c59
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WJG
Unit Serial No(VPD) : V1H22WJG
GUID : 5000cca0bc3c2c58
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 3
SAS Address : 5000cca-0-bc3c-2c5d
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WKG
Unit Serial No(VPD) : V1H22WKG
GUID : 5000cca0bc3c2c5c
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 4
SAS Address : 5000cca-0-bc3c-3411
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23DGG
Unit Serial No(VPD) : V1H23DGG
GUID : 5000cca0bc3c3410
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 5
SAS Address : 5000cca-0-bc3c-2ded
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22ZTG
Unit Serial No(VPD) : V1H22ZTG
GUID : 5000cca0bc3c2dec
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 6
SAS Address : 5000cca-0-bc3c-3a85
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23UTG
Unit Serial No(VPD) : V1H23UTG
GUID : 5000cca0bc3c3a84
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 7
SAS Address : 5000cca-0-bc3c-3649
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23K1G
Unit Serial No(VPD) : V1H23K1G
GUID : 5000cca0bc3c3648
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 8
SAS Address : 5000cca-0-bc3c-2c71
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WRG
Unit Serial No(VPD) : V1H22WRG
GUID : 5000cca0bc3c2c70
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 9
SAS Address : 5000cca-0-bc3c-2899
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22MTG
Unit Serial No(VPD) : V1H22MTG
GUID : 5000cca0bc3c2898
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 2
Slot # : 10
SAS Address : 5000cca-0-bc3c-3b35
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23W6G
Unit Serial No(VPD) : V1H23W6G
GUID : 5000cca0bc3c3b34
Protocol : SAS
Drive Type : SAS_HDD
Device is a Enclosure services device
Enclosure # : 2
Slot # : 12
SAS Address : 5003048-0-17d0-747d
State : Standby (SBY)
Manufacturer : SMC
Model Number : SC826-P
Firmware Revision : 100b
Serial No : x286616110
Unit Serial No(VPD) : N/A
GUID : N/A
Protocol : SAS
Device Type : Enclosure services device
Device is a Hard disk
Enclosure # : 3
Slot # : 0
SAS Address : 5000cca-0-bc3c-292e
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22NZG
Unit Serial No(VPD) : V1H22NZG
GUID : 5000cca0bc3c292c
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 1
SAS Address : 5000cca-0-bc3c-2666
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22H7G
Unit Serial No(VPD) : V1H22H7G
GUID : 5000cca0bc3c2664
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 2
SAS Address : 5000cca-0-bc3c-2c5a
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WJG
Unit Serial No(VPD) : V1H22WJG
GUID : 5000cca0bc3c2c58
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 3
SAS Address : 5000cca-0-bc3c-2c5e
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WKG
Unit Serial No(VPD) : V1H22WKG
GUID : 5000cca0bc3c2c5c
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 4
SAS Address : 5000cca-0-bc3c-3412
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23DGG
Unit Serial No(VPD) : V1H23DGG
GUID : 5000cca0bc3c3410
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 5
SAS Address : 5000cca-0-bc3c-2dee
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22ZTG
Unit Serial No(VPD) : V1H22ZTG
GUID : 5000cca0bc3c2dec
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 6
SAS Address : 5000cca-0-bc3c-3a86
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23UTG
Unit Serial No(VPD) : V1H23UTG
GUID : 5000cca0bc3c3a84
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 7
SAS Address : 5000cca-0-bc3c-364a
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23K1G
Unit Serial No(VPD) : V1H23K1G
GUID : 5000cca0bc3c3648
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 8
SAS Address : 5000cca-0-bc3c-2c72
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22WRG
Unit Serial No(VPD) : V1H22WRG
GUID : 5000cca0bc3c2c70
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 9
SAS Address : 5000cca-0-bc3c-289a
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H22MTG
Unit Serial No(VPD) : V1H22MTG
GUID : 5000cca0bc3c2898
Protocol : SAS
Drive Type : SAS_HDD
Device is a Hard disk
Enclosure # : 3
Slot # : 10
SAS Address : 5000cca-0-bc3c-3b36
State : Ready (RDY)
Size (in MB)/(in sectors) : 3815447/976754645
Manufacturer : HGST
Model Number : HUS726T4TAL4201
Firmware Revision : B460
Serial No : V1H23W6G
Unit Serial No(VPD) : V1H23W6G
GUID : 5000cca0bc3c3b34
Protocol : SAS
Drive Type : SAS_HDD
Device is a Enclosure services device
Enclosure # : 3
Slot # : 12
SAS Address : 5003048-0-17d0-74fd
State : Standby (SBY)
Manufacturer : SMC
Model Number : SC826-S
Firmware Revision : 100b
Serial No : x286616110
Unit Serial No(VPD) : N/A
GUID : N/A
Protocol : SAS
Device Type : Enclosure services device
------------------------------------------------------------------------
Enclosure information
------------------------------------------------------------------------
Enclosure# : 1
Logical ID : 50030480:1cebcb03
Numslots : 8
StartSlot : 0
Enclosure# : 2
Logical ID : 50030480:17d0747f
Numslots : 31
StartSlot : 0
Enclosure# : 3
Logical ID : 50030480:17d0747f
Numslots : 31
StartSlot : 0
------------------------------------------------------------------------
SAS3IRCU: Command DISPLAY Completed Successfully.
SAS3IRCU: Utility Completed Successfully.
root@NSA[~]#
Perhaps create a new thread detailing your hardware. This is especially important when dealing with multipath systems. If you can also attach the output of the following commands.
root@NSA[~]# zpool status
pool: freenas-boot
state: ONLINE
status: One or more features are enabled on the pool despite not being
requested by the 'compatibility' property.
action: Consider setting 'compatibility' to an appropriate value, or
adding needed features to the relevant file in
/etc/zfs/compatibility.d or /usr/share/zfs/compatibility.d.
scan: scrub repaired 0B in 00:00:22 with 0 errors on Tue Nov 25 03:45:24 2025
config:
NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
nvme0n1p2 ONLINE 0 0 0
errors: No known data errors
pool: pool1
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 05:43:06 with 0 errors on Sun Nov 2 05:43:08 2025
config:
NAME STATE READ WRITE CKSUM
pool1 ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
sdk2 ONLINE 0 0 0
sdv2 ONLINE 0 0 0
sdu2 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
sdp2 ONLINE 0 0 0
sdo2 ONLINE 0 0 0
sdq2 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
sds2 ONLINE 0 0 0
sdr2 ONLINE 0 0 0
sdt2 ONLINE 0 0 0
spares
sdn2 AVAIL
sdm2 AVAIL
errors: No known data errors
Apparently, I have to open the NAS and unplug one of the “path” to the enclosure
there should be two cables and I should unplug one
