Ask to add the system is running a dual 10gb nic card
I really appreciate the help guys
These are to be done inside TrueNAS. You can try using the GUI Shell or SSH and a CLI window, if you have that set up. Not all the commands will return results.
Inside GUI Shell
Thanks to Protopia for the following.
‘I have a standard set of commands I ask people to run to provide a detailed breakdown of the hardware, so please run these and post the output here (with the output of each command inside a separate </> preformatted text box) so that we can all see the details:’
lsblk -bo NAME,MODEL,ROTA,PTTYPE,TYPE,START,SIZE,PARTTYPENAME,PARTUUID
sudo zpool status -v
sudo zpool import
lspci
sudo storcli show all
sudo sas2flash -list
sudo sas3flash -list
What motherboard do you have? You list 2 graphics cards, the HBA and a dual 10Gbps NIC. You need to make sure you have enough of the correct types of slots and lanes.
I have an asus x299 tuf mark 2 motherboard and a i9 10940X cpu and Lenovo 430-16I LSI SAS3416 9400-16I HBA 12 Gbps PCIe 16 Port IT Mode +4*SFF-8643
Do you have plenty of air flow going over your HBA? These are designed for servers and need high flow air going over them or they can cause errors. It may explain your issues.
HBA 9400-16i and HBA 9400-8i Tri-Mode Storage Adapters QIG - Broadcom
The following table shows the required airflow and inlet temperature for the HBA 9400-16i and HBA 9400-8i Tri-Mode storage adapters. The adapter requires appropriate airflow and inlet temperature to avoid operating the Tri-Mode I/O controller (SAS3416 or SAS3408) above the maximum junction
https://docs.broadcom.com/doc/pub-005692
Sorry for the delay in my response I was away but while I was away I was thinking the same thing,but thanks for confirming that idea with the documentation as well, so I am going to upgrade my fans, to increase the air flow within my case.
While upgrading, focus on the airflow across the HBA. When it is rated in linear feet of air, it needs air flow. Those screaming fans are what it wants, most of us would rather a quieter system.
Could i ask what RPM are your cpu fan and case fans please …?
Ok I thing i might need to attach a fan or 2 to the card in some way, could ask what rpm would you recommend …?
I don’t have screaming fans, but I have a monster full tower case with plenty of room. So instead of small screaming 20-40mm fans, I have 5x 140mm fans spinning at low rpm’s for quiet operation.
CPU fan is generally at 2900 RPM and case fans are just at 1100 RPM.
The case and fans are listed above:
Fractal Design Define 7 XL
5x Arctic P14 PWM PST 140mm.
You need to tell us what case you have so we can make an accurate assessment of what you need to do and whether or not your airflow is sufficient.
It is not about RPM, but air flow rate, or CFM. And true, you do not need screaming fans, but that is what these HBAs were designed to go into, a true server with lots of airflow.
Just inspect your case to see what you might have to do to ensure you have great airflow across that HBA. If you cannot figure it out or just want an opinion on how it might be done, send me a message and include many photos of the case, outside and inside. And if you are not afraid to modify your case if needed (cut a hole into it). If you have a 3D printer, you may find an HBA fan mount online or can make your own.
Ok thank you for that I am just in the process now of making a bracket to mount two small fans beside it as I don’t have a lot of space under between cards, I will post a picture once I am done
First and foremost I would like to say thank you for everyone’s help.
So what I have done is create a bracket to hold 2X 80mm fans to the side of my lsi 9400,10gb Nic card and 2.5 nic card to create a constant air flow directly to the cards. and I can now confirm that my previous fault which was one of my mirror raids had degraded, has now seemed to disappeared and fully functional again.
Please excuse the metal work I plan to re do it again once it had proven it would work.
1 Like
The only problem I have now is these messages keep repeating in truenas scale shell, does anyone know what could be causing this …?
error screen shot below
The CPU fan is Thermalright Peerless Assassin 120 Digital Black CPU Air Cooler, with 2x fan maximum rotational speed 1850 RPM, and I have an Lian li full tower case with 3x lian li fans of a maximum speed of 1200 Rpm at the front and 1x corsair af120 1500rpm at the back of the case, and 1x corsair af120 1500rpm at the top of the case
Hello everyone and thank you for your assistance as it was greatly appreciated, so after increasing my airflow within my server case I found that things got better but I was still having issues with system crashing and Truenas scales and other lxc and vms working within proxmox.
So after a lot of testing and research I main the main root of my problem was mismatched memory speeds after running a memory test which found over 600 error, so I removed the lower speed memory and ran the test again and everything was good, then ran a test with just the lower speed memory and once again it work fine. so now I have purchased 2 new memory stick of the same speed and fit them and ran another test with no errors and everything is working perfectly. So now all my dim slots are filled with ddr4 2666mhz and not mixed with ddr4 with 2133mhz.
2 Likes
It’s interesting that the board doesn’t just default to the lower speed (2133 Mhz). I would think it would do that automatically.
It may be the order the memory is inserted in. First slot may have had the higher speed memory and it got set by that and we don’t have a report of what speed the MB was running the original, combined speed RAM. Could have been fast or slow and it just didn’t like it.