Broadcom 9500-16i ... no BIOS? Firmware updates not supported

Astronaut · December 17, 2024, 11:56am

I believe this isn’t really a TrueNAS issue but more a question of me being stupid. However, I bought a Broadcom 9500-16i on eBay. The circuit board says Broadcom. TrueNAS identifies it as a Broadcom 9500-16i.

I have now connected 8 drives to it (3x16 TB, 5x8TB). After testing for about 24 hours it seems to work fine except:

Firmware is ancient (21.00.00.00)
Board doesn’t show up in BIOS (My Intel X550 does show up in BIOS)
Most “storcli” commands in TrueNAS fails with “Un-supported Command” (e.g. “storcli /c0 show bios” fails this way)
Attempts to flash firmware fails with “Flash image contains invalid secure hash key.”
Attempts to flash bios also fails with invalid secure hash key.

I am not really sure what is going on. First time using Broadcom HBA’s. Any help would be appreciated.

Details:

Updating firmware

I tried both the P32 and P33 versions of both Mixed Profile and SAS+SATA (files HBA_9500-16i_Mixed_Profile.bin and HBA_9500-16i_SAS_SATA_Profile.bin)

Command: storcli /c0 download file=HBA_9500-16i_SAS_SATA_Profile.bin

Downloading image.Please wait...

CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.6.44-production+truenas
Controller = 0
Status = Failure
Description = Flash image contains invalid secure hash key.

Updating BIOS

I tried both the P32 and P33 BIOS. Filename: IT_HBA_X64_BIOS_PKG_E6.rom

Command: storcli /c0 download bios file=IT_HBA_X64_BIOS_PKG_E6.rom

Downloading image.Please wait...

CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.6.44-production+truenas
Controller = 0
Status = Failure
Description = Flash image contains invalid secure hash key.

storcli /c0 show all output

CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.6.44-production+truenas
Controller = 0
Status = Success
Description = None


Basics :
======
Controller = 0
Adapter Type =   SAS3816(A0)
Model = HBA 9500-16i
Serial Number = SKC1174***
Current System Date/time = 12/17/2024 11:48:53
Concurrent commands supported = 6272
SAS Address =  500062b20cb96a80
PCI Address = 00:04:00:00


Version :
=======
Firmware Package Build = 21.00.00.00
Firmware Version = 21.00.00.00
NVDATA Version = 21.00.00.11
Driver Name = mpt3sas
Driver Version = 43.100.00.00


PCI Version :
===========
Vendor Id = 0x1000
Device Id = 0xE6
SubVendor Id = 0x1000
SubDevice Id = 0x4050
Host Interface = PCIE
Device Interface = PCIe-8GT/s
Bus Number = 4
Device Number = 0
Function Number = 0
Domain ID = 0


Pending Images in Flash :
=======================
Image name = No pending images


Status :
======
Controller Status = OK
Memory Correctable Errors = 0
Memory Uncorrectable Errors = 0
Bios was not detected during boot = No
Controller has booted into safe mode = No
Controller has booted into certificate provision mode = No
Package Stamp Mismatch = Yes


Supported Adapter Operations :
============================
Alarm Control = No
Cluster Support = No
Self Diagnostic = No
Deny SCSI Passthrough = No
Deny SMP Passthrough = No
Deny STP Passthrough = No
Support more than 8 Phys = Yes
FW and Event Time in GMT = No
Support Enclosure Enumeration = Yes
Support Allowed Operations = Yes
Support Multipath = Yes
Support Security = Yes
Support Config Page Model = No
Support the OCE without adding drives = No
support EKM = No
Snapshot Enabled = No
Support PFK = No
Support PI = No
Support Shield State = No
Support Set Link Speed = No
Support JBOD = No
Disable Online PFK Change = No
Real Time Scheduler = No
Support Reset Now = No
Support Emulated Drives = No
Support Secure Boot = Yes
Support Platform Security = No
Support Package Stamp Mismatch Reporting = Yes
Support PSOC Update = No
Support PSOC Part Information = No
Support PSOC Version Information = No


HwCfg :
=====
ChipRevision =  A0
BatteryFRU = N/A
Front End Port Count = 1
Backend Port Count = 21
Serial Debugger = Absent
NVRAM Size = 0KB
Flash Size = 16MB
On Board Memory Size = 0MB
On Board Expander = Absent
Temperature Sensor for ROC = Present
Temperature Sensor for Controller = Absent
Current Size of CacheCade (GB) = 0
Current Size of FW Cache (MB) = 0
ROC temperature(Degree Celsius) = 78


Policies :
========

Policies Table :
==============

------------------------------------------------
Policy                          Current Default
------------------------------------------------
Predictive Fail Poll Interval   0 sec
Interrupt Throttle Active Count 0
Interrupt Throttle Completion   0 us
Rebuild Rate                    0 %     30%
PR Rate                         0 %     30%
BGI Rate                        0 %     30%
Check Consistency Rate          0 %     30%
Reconstruction Rate             0 %     30%
Cache Flush Interval            0s
------------------------------------------------

Flush Time(Default) = 4s
Drive Coercion Mode = none
Auto Rebuild = Off
Battery Warning = Off
ECC Bucket Size = 0
ECC Bucket Leak Rate (hrs) = 0
Restore HotSpare on Insertion = Off
Expose Enclosure Devices = Off
Maintain PD Fail History = Off
Reorder Host Requests = On
Auto detect BackPlane = SGPIO/i2c SEP
Load Balance Mode = None
Security Key Assigned = Off
Disable Online Controller Reset = Off
Use drive activity for locate = Off


Boot :
====
Max Drives to Spinup at One Time = 2
Maximum number of direct attached drives to spin up in 1 min = 60
Delay Among Spinup Groups (sec) = 2
Allow Boot with Preserved Cache = On


Defaults :
========
Phy Polarity = 0
Phy PolaritySplit = 0
Cached IO = Off
Default spin down time (mins) = 0
Coercion Mode = None
ZCR Config = Unknown
Max Chained Enclosures = 0
Direct PD Mapping = No
Restore Hot Spare on Insertion = No
Expose Enclosure Devices = No
Maintain PD Fail History = No
Zero Based Enclosure Enumeration = No
Disable Puncturing = No
Un-Certified Hard Disk Drives = Block
SMART Mode = Mode 6
Enable LED Header = No
LED Show Drive Activity = No
Dirty LED Shows Drive Activity = No
EnableCrashDump = No
Disable Online Controller Reset = No
Treat Single span R1E as R10 = No
Power Saving option = Enable
TTY Log In Flash = No
Auto Enhanced Import = No
Enable Shield State = No
Time taken to detect CME = 60 sec


Capabilities :
============
Supported Drives = SAS, SATA
Enable JBOD = Yes
Max Parallel Commands = 6272
Max SGE Count = 128
Max Data Transfer Size = 32 sectors
Max Strips PerIO = 0
Max Configurable CacheCade Size = 0
Min Strip Size = 512Bytes
Max Strip Size = 512Bytes

Scheduled Tasks = NA

Secure Boot :
===========
Secure Boot Enabled = Yes
Controller in Soft Secure Mode = No
Controller in Hard Secure Mode = Yes
Key Update Pending = No
Remaining Secure Boot Key Slots = 6


Security Protocol properties :
============================
Security Protocol = None


Enclosure Information :
=====================

------------------------------------------------------------------
EID State Slots PD PS Fans TSs Alms SIM ProdID     VendorSpecific
------------------------------------------------------------------
  0 OK       16  8  0    0   0    0   0 VirtualSES
------------------------------------------------------------------


Physical Device Information :
===========================

Drive /c0/e0/s0 :
===============

----------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model           Sp
----------------------------------------------------------------------
0:0       1 JBOD  -  7.277 TB SATA HDD -   -  512B TOSHIBA HDWF180 -
----------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s0 - Detailed Information :
======================================

Drive /c0/e0/s0 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s0 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA HDWF180
NAND Vendor = NA
SN =         Z9IDK132FB6G
WWN = 50000399BBD0190E
Firmware Revision = GX0B
Raw size = 7.277 TB [0x3a3812aaf Sectors]
Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Non Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 15628053167
Connector Name = C0.0 x1


Drive /c0/e0/s0 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 0(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a80
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 39 5a 44 49
31 4b 32 33 42 46 47 36 00 00 00 00 00 00 58 47
42 30 20 20 20 20 4f 54 48 53 42 49 20 41 44 48
46 57 38 31 20 30 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 01 ff ff ff 0f 07 00 07 00



Drive /c0/e0/s1 :
===============

---------------------------------------------------------------------------
EID:Slt DID State DG      Size Intf Med SED PI SeSz Model               Sp
---------------------------------------------------------------------------
0:1       2 JBOD  -  14.551 TB SATA HDD -   -  512B TOSHIBA MG08ACA16TE -
---------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s1 - Detailed Information :
======================================

Drive /c0/e0/s1 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s1 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA MG08ACA16TE
NAND Vendor = NA
SN =         Z1E0A2VCFVGG
WWN = 5000039B58D2AB6F
Firmware Revision = 0102
Raw size = 14.551 TB [0x746bfffff Sectors]
Coerced size = 14.551 TB [0x746bfffff Sectors]
Non Coerced size = 14.551 TB [0x746bfffff Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 31251759103
Connector Name = C0.0 x1


Drive /c0/e0/s1 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 1(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a81
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 31 5a 30 45
32 41 43 56 56 46 47 47 00 00 00 00 00 00 31 30
32 30 20 20 20 20 4f 54 48 53 42 49 20 41 47 4d
38 30 43 41 31 41 54 36 20 45 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 5d ff ff ff 0f 07 00 07 00



Drive /c0/e0/s2 :
===============

----------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model           Sp
----------------------------------------------------------------------
0:2       3 JBOD  -  7.277 TB SATA HDD -   -  512B TOSHIBA HDWF180 -
----------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s2 - Detailed Information :
======================================

Drive /c0/e0/s2 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s2 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA HDWF180
NAND Vendor = NA
SN =         Z9L6K0XXFB6G
WWN = 50000399BB980E48
Firmware Revision = GX0B
Raw size = 7.277 TB [0x3a3812aaf Sectors]
Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Non Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 15628053167
Connector Name = C0.0 x1


Drive /c0/e0/s2 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 2(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a82
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 39 5a 36 4c
30 4b 58 58 42 46 47 36 00 00 00 00 00 00 58 47
42 30 20 20 20 20 4f 54 48 53 42 49 20 41 44 48
46 57 38 31 20 30 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 01 ff ff ff 0f 07 00 07 00



Drive /c0/e0/s3 :
===============

--------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model               Sp
--------------------------------------------------------------------------
0:3       4 JBOD  -  7.277 TB SATA HDD -   -  512B TOSHIBA MG05ACA800E -
--------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s3 - Detailed Information :
======================================

Drive /c0/e0/s3 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s3 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA MG05ACA800E
NAND Vendor = NA
SN =         10U5KLZFFUUD
WWN = 50000399CB901F09
Firmware Revision = GX2A
Raw size = 7.277 TB [0x3a3812aaf Sectors]
Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Non Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 15628053167
Connector Name = C0.0 x1


Drive /c0/e0/s3 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 3(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a83
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 30 31 35 55
4c 4b 46 5a 55 46 44 55 00 00 00 00 00 00 58 47
41 32 20 20 20 20 4f 54 48 53 42 49 20 41 47 4d
35 30 43 41 38 41 30 30 20 45 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 01 ff ff ff 0f 07 00 07 00



Drive /c0/e0/s4 :
===============

----------------------------------------------------------------------------
EID:Slt DID State DG      Size Intf Med SED PI SeSz Model                Sp
----------------------------------------------------------------------------
0:4       5 JBOD  -  14.551 TB SATA HDD -   -  512B ST16000NM001G-2KK103 -
----------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s4 - Detailed Information :
======================================

Drive /c0/e0/s4 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s4 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = ST16000NM001G-2KK103
NAND Vendor = NA
SN =             ZL2KW1R2
WWN = 5000C500DC0BF705
Firmware Revision = SB30
Raw size = 14.551 TB [0x746bfffff Sectors]
Coerced size = 14.551 TB [0x746bfffff Sectors]
Non Coerced size = 14.551 TB [0x746bfffff Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 31251759103
Connector Name = C0.1 x1


Drive /c0/e0/s4 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 4(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a84
-----------------------------------------


Inquiry Data =
5a 0c ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 20 20 20 20
4c 5a 4b 32 31 57 32 52 00 00 00 00 00 00 42 53
30 33 20 20 20 20 54 53 36 31 30 30 4e 30 30 4d
31 30 2d 47 4b 32 31 4b 33 30 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 40 00 2f 00 40 00 02 00 02 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 5d ff ff ff 0f 00 00 07 00



Drive /c0/e0/s5 :
===============

---------------------------------------------------------------------------
EID:Slt DID State DG      Size Intf Med SED PI SeSz Model               Sp
---------------------------------------------------------------------------
0:5       6 JBOD  -  14.551 TB SATA HDD -   -  512B TOSHIBA MG08ACA16TE -
---------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s5 - Detailed Information :
======================================

Drive /c0/e0/s5 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s5 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA MG08ACA16TE
NAND Vendor = NA
SN =         2270A1EVFVGG
WWN = 5000039B78CB4831
Firmware Revision = 0102
Raw size = 14.551 TB [0x746bfffff Sectors]
Coerced size = 14.551 TB [0x746bfffff Sectors]
Non Coerced size = 14.551 TB [0x746bfffff Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 31251759103
Connector Name = C0.1 x1


Drive /c0/e0/s5 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 5(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a85
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 32 32 30 37
31 41 56 45 56 46 47 47 00 00 00 00 00 00 31 30
32 30 20 20 20 20 4f 54 48 53 42 49 20 41 47 4d
38 30 43 41 31 41 54 36 20 45 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 5d ff ff ff 0f 07 00 07 00



Drive /c0/e0/s6 :
===============

--------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model               Sp
--------------------------------------------------------------------------
0:6       7 JBOD  -  7.277 TB SATA HDD -   -  512B TOSHIBA MG05ACA800E -
--------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s6 - Detailed Information :
======================================

Drive /c0/e0/s6 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s6 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA MG05ACA800E
NAND Vendor = NA
SN =         30BXKI8KFUUD
WWN = 50000399EC700BF0
Firmware Revision = GX2A
Raw size = 7.277 TB [0x3a3812aaf Sectors]
Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Non Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 15628053167
Connector Name = C0.1 x1


Drive /c0/e0/s6 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 6(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a86
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 30 33 58 42
49 4b 4b 38 55 46 44 55 00 00 00 00 00 00 58 47
41 32 20 20 20 20 4f 54 48 53 42 49 20 41 47 4d
35 30 43 41 38 41 30 30 20 45 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 01 ff ff ff 0f 07 00 07 00



Drive /c0/e0/s7 :
===============

--------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model               Sp
--------------------------------------------------------------------------
0:7       8 JBOD  -  7.277 TB SATA HDD -   -  512B TOSHIBA MG05ACA800E -
--------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup
UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition


Drive /c0/e0/s7 - Detailed Information :
======================================

Drive /c0/e0/s7 State :
=====================
Shield Counter = N/A
Media Error Count = N/A
Other Error Count = N/A
Predictive Failure Count = N/A
S.M.A.R.T alert flagged by drive = N/A


Drive /c0/e0/s7 Device attributes :
=================================
Manufacturer Id = ATA
Model Number = TOSHIBA MG05ACA800E
NAND Vendor = NA
SN =         50I7KIFPF56E
WWN = 5000039A0BA00E6E
Firmware Revision = GX4K
Raw size = 7.277 TB [0x3a3812aaf Sectors]
Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Non Coerced size = 7.277 TB [0x3a3812aaf Sectors]
Device Speed = 6.0Gb/s
Link Speed = 6.0Gb/s
NCQ setting = N/A
Sector Size = 512B
Config ID = NA
Number of Blocks = 15628053167
Connector Name = C0.1 x1


Drive /c0/e0/s7 Policies/Settings :
=================================
Enclosure position = 0
Connected Port Number = 7(path0)
Sequence Number = 0
Commissioned Spare = No
Emergency Spare = No
Last Predictive Failure Event Sequence Number = N/A
Successful diagnostics completion on = N/A
SED Capable = N/A
SED Enabled = N/A
Secured = N/A
Needs EKM Attention = N/A
PI Eligible = N/A
Certified = N/A
Wide Port Capable = N/A
Multipath = No

Port Information :
================

-----------------------------------------
Port Status Linkspeed SAS address
-----------------------------------------
   0 Active 6.0Gb/s   0x300062b20cb96a87
-----------------------------------------


Inquiry Data =
40 00 ff 3f 37 c8 10 00 00 00 00 00 3f 00 00 00
00 00 00 00 20 20 20 20 20 20 20 20 30 35 37 49
49 4b 50 46 35 46 45 36 00 00 00 00 00 00 58 47
4b 34 20 20 20 20 4f 54 48 53 42 49 20 41 47 4d
35 30 43 41 38 41 30 30 20 45 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 10 80
00 00 00 2f 00 40 00 02 00 00 07 00 ff 3f 10 00
3f 00 10 fc fb 00 10 01 ff ff ff 0f 07 00 07 00

ericloewe · December 17, 2024, 2:25pm

Do you mean specifically the device menus, as implemented by the UEFI extension ROM? LSI/Broadcom SAS controllers do have these, but there are catches:

The relevant option ROM might not be present on the card
The slot may have option ROMs disabled or otherwise made useless (e.g. BIOS only)
The system firmware may simply be buggy and now show it

Curious… There are a few things to try:

Use the latest storcli from Broadcom
Check that the downloaded firmware was correctly downloaded
Make triple sure you don’t have an OEM card. For instance, I had to get firmware directly from Supermicro for a 9500 in a pre-built Supermicro server, which was not the case for earlier cards.

Astronaut · December 18, 2024, 3:27pm

Yes.

I don’t know what to look for.

I tried that. I tried running it from Ubuntu and Windows Server 2022. Same result.

From everything I could see it matched. In addition I tried the P22 version (the card have P21). Same result.

It was sold to me as a Broadcom card. It has Broadcom written on the circuit board. I bought it on eBay from a store that sells both on eBay and on their own website.

I will ask them. But right now it works like a charm except that the firmware is ancient. I don’t have a need for the UEFI bios to work. However it is wierd.

ericloewe · December 18, 2024, 3:54pm

Don’t worry about this at all until we get the firmware updated properly, and even then the usefulness is limited.

Try the UEFI shell and the UEFI version of storcli. Let’s try to remove as many layers as possible.

Astronaut · December 19, 2024, 9:44am

I got the UEFI shell running and tried running storcli.efi. Same result. Error message for both firmware and BIOS “download” is “Flash image contains invalid secure hash key.”

It is weird. I am downloading the firmware directly from the Broadcom website. From here: https://www.broadcom.com/products/storage/host-bus-adapters/sas-nvme-9500-16i.

The download firmware command in storcli has a “force” switch. I have been hesitant to use it as I am afraid of bricking my card (which is actually working nicely … just afraid that the old firmware has bugs that have been fixed in later releases).

ericloewe · December 19, 2024, 12:29pm

Yeah, my experience with the 9500 has been a bit more painful than I’d like (custom Supermicro variant that only takes, by default, Supermicro-signed firmware), but yours sounds like it’s on another level.

What I really don’t get is how the hell the card is working at least reasonably well, even though sotrcli hates it so much.

You mentioned some housekeeping commands would fail with Linux/Windows storcli, did you try any of those with the EFI version?

Astronaut · December 20, 2024, 9:36am

I did run some of them. I did not notice any differences. Things like eventlog, model number, serial number and temperature worked. Other things didn’t. In the eventlog the first entry was from September 2024. Thus, either the log has been erased or the card is new as advertised.