Will using two cables between a single SAS controller and this expander card be of any benefit?
My SAS 12Gb/s Controller has 4 connection ports, and I plan to use two 82885T expanders.
Each expander will have sixteen 3.5" SAS 12Gb/s drives at 7200RPM directly connected to 4 ports.
I don’t imagine throughput will be an issue either way, but will it be good or bad to use “twin uplink” cables since I’ll have four ports on the controller connected to just two expanders?
Since Truenas CE doesn’t support multipath there may be an issue with disks being shown twice in the gui, once as member of a pool and once unassigned, i wouldn’t do it
SAS Expanders and SAS 16 port HBAs are complicated.
If I understand correctly, some of the PCIe cards for LSI 16 port HBAs are 2 x 8 port SAS chips. Thus, selecting 1 x 4 lane cable path from each chip is Multipathing. Which, as @LarsR stated is not supported.
However, using both 4 lane cable paths from the SAME SAS chip to the same SAS Expander should be supported. Since you plan on 2 separate SAS Expanders, this works.
Now to be clear, SAS does not “properly” load share across the SAS lanes. Whether that is the stock single 4 lane cable, or 2 x 4 lane cables. SAS just does some primitive round robin path selection. And if that path dies, then the data / disk dies too. (Sort of…) Basically, SAS HBAs and Expanders won’t automatically re-path the data. At least to my understanding.
So… I’m using the 82885T in JBODs with dual-cables and have been for years.
It should be noted, Wide-port and dual-path are not the same!!!
and LLMs/bad documentation will send you in circles if you don’t know the difference.
Yes, you can so long as your HBA supports “wide-port”.
Wide-port is combining multiple backplane links to an expander to add additional bandwidth, it can have some loose “failover” in that if a cable fails it will fall back to a standard link. it can work with any type of disk (SAS/SATA/ATAPI/etc). it is completely transparent to the host OS and any software.
Dual-path is a special function of SAS that allows dual-redundant paths to each disk, through the entire SAS hardware chain. you will see multiple copies of each disk in your OS and software has to understand this (TrueNAS CE does not)
TrueNAS generally will initialize hardware with wide-port automatically when it can (this is what you want). sometimes if you hotplug a SAS JBOD w/ SAS disks in certain ways you will get a dual-path config and TrueNAS will start whining about duplicate serial numbers and the disks UI will bug out… try to avoid hotpluging the entire JBOD w/ disks inserted.
LSI-9200 series and above all do. (if you are using one of the dual-chip HBAs like the 9300-16e you’ll need to plug both into the same half of the HBA)
7 series HBAs from Adaptec (ie the 78165) do not, and will not see your disks if you try it. (unsure about Adaptec’s newer HBAs)