HI, I put in 6 - 20 TB Nvme drives but the partition is unknown partition is unrecognized. I’m trying to get these drives to work, They are in a DL360 Gen10, any help is appreciated.
Error: /dev/nvme3n1: unrecognised disk label
Model: 4.8 TB NVMe G3 Tier-1 Flash (nvme)
Disk /dev/nvme3n1: 22.0TB
Sector size (logical/physical): 512B/512B
Partition Table: unknown
Disk Flags:
Thank you,
Have you tried wiping them in the TrueNAS GUI under Disks?
You may want to look into which formatting types these drives support, and put them in a more useful format with 4K sectors or larger.
I had a Dell-rebranded PM1725a which could not be recognised by macOS, while a genuine PM1725a was. After a round trip to a readily available machine that had CORE installed and reformatting to 4K with nvmecontrol format -f 02 nvme0, the drive was recognised by macOS and could be initialised.
The corresponding command under SCALE should be nvme.
What drive is it? 4.8 TB or 22 TB?
Hi, these are IBM drives, looks like they write a 5 TB partition on it but the actual drive is 20TB.
So what I understand is install CORE and try using the nvme command you provided ?
I can install core with no issues and see if that helps if I cannot get them formatted in scale.
Here is a link to the details of the drives.
Yes, with no luck.
Oh, that’s a very special beast. Maybe one of the IT proferssional here has experience with these?
I’m more familiar with CORE, so I use it. If you have SCALE installed, I rather suggest you find your way with whatever nvme utility is there, which should be ‘nvme’ or ‘nvme-cli’, as the package is known. Browsing through the man pages of what’s installed on your production NAS will be more useful than learning commands on an OS you don’t use.
https://manpages.debian.org/testing/nvme-cli/nvme.1.en.html
Begin by poking the drive with nvme list, id(entify) to see how it reports. The 5 TB might be a namespace.
Will do later today and will update with any results.
Thank you.
Ok, no luck, I performed a wipe on the GUI of 4 20TB drives, and rebooted and still getting error "Error fsyncing/closing /dev/nvme2n1: Input/output error " when creating a pool, tried different raid configs with no luck. On two 20 TB drives I deleted namespace and detached it and tried to do a mirror, no luck. I also created a namespace less than the 4.8 TB also no luck.
Not sure what the heck to do, if anyone has any ideas please share. Here are some commands I ran to create the 4 TB namespace.
admin@truenas[~]$ sudo nvme create-ns /dev/nvme4 --nsze=8589934592 --ncap=8589934592 --flbas=0 -dps=0
create-ns: Success, created nsid:1
admin@truenas[~]$ sudo nvme create-ns /dev/nvme5 --nsze=8589934592 --ncap=8589934592 --flbas=0 -dps=0
create-ns: Success, created nsid:1
admin@truenas[~]$ sudo nvme attach-ns /dev/nvme4 --namespace-id=1 -controllers=0
attach-ns: Success, nsid:1
admin@truenas[~]$ sudo nvme attach-ns /dev/nvme5 --namespace-id=1 -controllers=0
attach-ns: Success, nsid:1
What does lsblk say?
eg:
root@rawht[~/scripts]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
zd0 230:0 0 600G 0 disk
zd16 230:16 0 100G 0 disk
zd32 230:32 0 200G 0 disk
zd48 230:48 0 200G 0 disk
nvme4n1 259:0 0 54.9G 0 disk
├─nvme4n1p1 259:1 0 1M 0 part
├─nvme4n1p2 259:2 0 512M 0 part
└─nvme4n1p3 259:3 0 54.4G 0 part
nvme0n1 259:4 0 476.9G 0 disk
├─nvme0n1p1 259:10 0 2G 0 part
│ └─md127 9:127 0 2G 0 raid1
│ └─md127 253:1 0 2G 0 crypt [SWAP]
└─nvme0n1p2 259:11 0 474.9G 0 part
nvme1n1 259:5 0 476.9G 0 disk
├─nvme1n1p1 259:6 0 2G 0 part
│ └─md126 9:126 0 2G 0 raid1
│ └─md126 253:0 0 2G 0 crypt [SWAP]
└─nvme1n1p2 259:7 0 474.9G 0 part
nvme2n1 259:8 0 476.9G 0 disk
├─nvme2n1p1 259:12 0 2G 0 part
│ └─md126 9:126 0 2G 0 raid1
│ └─md126 253:0 0 2G 0 crypt [SWAP]
└─nvme2n1p2 259:13 0 474.9G 0 part
nvme3n1 259:9 0 476.9G 0 disk
├─nvme3n1p1 259:14 0 2G 0 part
│ └─md127 9:127 0 2G 0 raid1
│ └─md127 253:1 0 2G 0 crypt [SWAP]
└─nvme3n1p2 259:15 0 474.9G 0 part
Here is my output.
admin@truenas[~]$ sudo lsblk
[sudo] password for admin:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 1.1T 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 512M 0 part
├─sda3 8:3 0 1.1T 0 part
└─sda4 8:4 0 16G 0 part
└─sda4 253:0 0 16G 0 crypt [SWAP]
sdb 8:16 1 0B 0 disk
nvme0n1 259:0 0 20T 0 disk
nvme2n1 259:1 0 20T 0 disk
nvme3n1 259:2 0 20T 0 disk
nvme5n1 259:3 0 4T 0 disk
nvme1n1 259:4 0 20T 0 disk
One of them is reporting as a 4TB while the others report as 20T. You’ll have to delete that namespace and re-create a 20T one.
Can you also provide the output of
smartctl -a /dev/nvme0
smartctl -a /dev/nvme1
smartctl -a /dev/nvme2
etc…etc
Example should look like this:
root@rawht[~/scripts]# smartctl -a /dev/nvme1
smartctl 7.3 2022-02-28 r5338 [x86_64-linux-6.1.55-production+truenas] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Number: SAMSUNG MZVL2512HCJQ-00BL7
Serial Number: S64KNX2T223292
Firmware Version: CL2QGXA7
PCI Vendor/Subsystem ID: 0x144d
IEEE OUI Identifier: 0x002538
Total NVM Capacity: 512,110,190,592 [512 GB]
Unallocated NVM Capacity: 0
Controller ID: 6
NVMe Version: 1.3
Number of Namespaces: 1
Namespace 1 Size/Capacity: 512,110,190,592 [512 GB]
Namespace 1 Utilization: 376,036,102,144 [376 GB]
Namespace 1 Formatted LBA Size: 512
Namespace 1 IEEE EUI-64: 002538 b221d27ede
Local Time is: Thu Apr 18 14:19:39 2024 PDT
Firmware Updates (0x16): 3 Slots, no Reset required
Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test
Optional NVM Commands (0x0057): Comp Wr_Unc DS_Mngmt Sav/Sel_Feat Timestmp
Log Page Attributes (0x0e): Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg
Maximum Data Transfer Size: 128 Pages
Warning Comp. Temp. Threshold: 76 Celsius
Critical Comp. Temp. Threshold: 87 Celsius
Supported Power States
St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat
0 + 8.37W - - 0 0 0 0 0 0
1 + 8.37W - - 1 1 1 1 0 200
2 + 8.37W - - 2 2 2 2 0 200
3 - 0.0500W - - 3 3 3 3 2000 1200
4 - 0.0050W - - 4 4 4 4 500 9500
Supported LBA Sizes (NSID 0x1)
Id Fmt Data Metadt Rel_Perf
0 + 512 0 0
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SMART/Health Information (NVMe Log 0x02)
Critical Warning: 0x00
Temperature: 39 Celsius
Available Spare: 100%
Available Spare Threshold: 10%
Percentage Used: 8%
Data Units Read: 8,628,374 [4.41 TB]
Data Units Written: 54,841,872 [28.0 TB]
Host Read Commands: 300,493,179
Host Write Commands: 1,080,604,598
Controller Busy Time: 6,429
Power Cycles: 126
Power On Hours: 961
Unsafe Shutdowns: 47
Media and Data Integrity Errors: 0
Error Information Log Entries: 0
Warning Comp. Temperature Time: 0
Critical Comp. Temperature Time: 0
Temperature Sensor 1: 39 Celsius
Temperature Sensor 2: 43 Celsius
Thermal Temp. 1 Transition Count: 7
Thermal Temp. 2 Transition Count: 4
Thermal Temp. 1 Total Time: 966
Thermal Temp. 2 Total Time: 36
Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged
root@rawht[~/scripts]#
What happens when you try to make a pool without that drive in the UI?
Correct, 4TB was me testing yesterday, I need to move back nvme5 and nvme4 which is not currently configured, just wanted to see if I can get the others working and then I will do those two.
Here is the output of nvm0:
admin@truenas[/dev]$ sudo smartctl -a /dev/nvme0
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.1.74-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke,
=== START OF INFORMATION SECTION ===
Model Number: 4.8 TB NVMe G3 Tier-1 Flash
Serial Number: 01EK233YS1BBG99L03Y
Firmware Version: 1_2_12
PCI Vendor/Subsystem ID: 0x1014
IEEE OUI Identifier: 0x005076
Total NVM Capacity: 21,990,232,555,520 [21.9 TB]
Unallocated NVM Capacity: 0
Controller ID: 0
NVMe Version: 1.3
Number of Namespaces: 16
Local Time is: Thu Apr 18 17:36:23 2024 EDT
Firmware Updates (0x02): 1 Slot
Optional Admin Commands (0x000f): Security Format Frmw_DL NS_Mngmt
Optional NVM Commands (0x006c): DS_Mngmt Wr_Zero Resv Timestmp
Log Page Attributes (0x08): Telmtry_Lg
Maximum Data Transfer Size: 512 Pages
Warning Comp. Temp. Threshold: 85 Celsius
Critical Comp. Temp. Threshold: 95 Celsius
Supported Power States
St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat
0 + 0.00W - - 0 0 0 0 0 0
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SMART/Health Information (NVMe Log 0x02)
Critical Warning: 0x00
Temperature: 78 Celsius
Available Spare: 100%
Available Spare Threshold: 10%
Percentage Used: 0%
Data Units Read: 752,040,564 [385 TB]
Data Units Written: 787,532,860 [403 TB]
Host Read Commands: 6,163,611,444
Host Write Commands: 8,607,869,506
Controller Busy Time: 46,291
Power Cycles: 26
Power On Hours: 36,795
Unsafe Shutdowns: 0
Media and Data Integrity Errors: 0
Error Information Log Entries: 112
Warning Comp. Temperature Time: 0
Critical Comp. Temperature Time: 0
Temperature Sensor 1: 76 Celsius
Temperature Sensor 2: 77 Celsius
Temperature Sensor 3: 78 Celsius
Error Information (NVMe Log 0x01, 16 of 32 entries)
No Errors Logged
Self-tests not supported
admin@truenas[/dev]$ sudo smartctl -a /dev/nvme1
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.1.74-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke,
=== START OF INFORMATION SECTION ===
Model Number: 4.8 TB NVMe G3 Tier-1 Flash
Serial Number: 01EK233YS1BBG99L095
Firmware Version: 1_2_12
PCI Vendor/Subsystem ID: 0x1014
IEEE OUI Identifier: 0x005076
Total NVM Capacity: 21,990,232,555,520 [21.9 TB]
Unallocated NVM Capacity: 0
Controller ID: 0
NVMe Version: 1.3
Number of Namespaces: 16
Local Time is: Thu Apr 18 17:38:48 2024 EDT
Firmware Updates (0x02): 1 Slot
Optional Admin Commands (0x000f): Security Format Frmw_DL NS_Mngmt
Optional NVM Commands (0x006c): DS_Mngmt Wr_Zero Resv Timestmp
Log Page Attributes (0x08): Telmtry_Lg
Maximum Data Transfer Size: 512 Pages
Warning Comp. Temp. Threshold: 85 Celsius
Critical Comp. Temp. Threshold: 95 Celsius
Supported Power States
St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat
0 + 0.00W - - 0 0 0 0 0 0
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
SMART/Health Information (NVMe Log 0x02)
Critical Warning: 0x02
Temperature: 97 Celsius
Available Spare: 100%
Available Spare Threshold: 10%
Percentage Used: 0%
Data Units Read: 751,648,986 [384 TB]
Data Units Written: 789,397,139 [404 TB]
Host Read Commands: 6,180,892,872
Host Write Commands: 8,460,998,351
Controller Busy Time: 46,364
Power Cycles: 54
Power On Hours: 36,804
Unsafe Shutdowns: 0
Media and Data Integrity Errors: 0
Error Information Log Entries: 256
Warning Comp. Temperature Time: 1163
Critical Comp. Temperature Time: 8
Temperature Sensor 1: 93 Celsius
Temperature Sensor 2: 97 Celsius
Temperature Sensor 3: 96 Celsius
Error Information (NVMe Log 0x01, 16 of 32 entries)
No Errors Logged
Self-tests not supported
admin@truenas[/dev]$ sudo smartctl -a /dev/nvme2
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.1.74-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke,
=== START OF INFORMATION SECTION ===
Model Number: 4.8 TB NVMe G3 Tier-1 Flash
Serial Number: 01EK233YS1BBG99L060
Firmware Version: 1_2_12
PCI Vendor/Subsystem ID: 0x1014
IEEE OUI Identifier: 0x005076
Total NVM Capacity: 21,990,232,555,520 [21.9 TB]
Unallocated NVM Capacity: 0
Controller ID: 0
NVMe Version: 1.3
Number of Namespaces: 16
Local Time is: Thu Apr 18 17:38:53 2024 EDT
Firmware Updates (0x02): 1 Slot
Optional Admin Commands (0x000f): Security Format Frmw_DL NS_Mngmt
Optional NVM Commands (0x006c): DS_Mngmt Wr_Zero Resv Timestmp
Log Page Attributes (0x08): Telmtry_Lg
Maximum Data Transfer Size: 512 Pages
Warning Comp. Temp. Threshold: 85 Celsius
Critical Comp. Temp. Threshold: 95 Celsius
Supported Power States
St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat
0 + 0.00W - - 0 0 0 0 0 0
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
SMART/Health Information (NVMe Log 0x02)
Critical Warning: 0x02
Temperature: 93 Celsius
Available Spare: 100%
Available Spare Threshold: 10%
Percentage Used: 0%
Data Units Read: 754,291,699 [386 TB]
Data Units Written: 780,100,348 [399 TB]
Host Read Commands: 6,175,366,424
Host Write Commands: 8,463,580,763
Controller Busy Time: 46,119
Power Cycles: 44
Power On Hours: 36,804
Unsafe Shutdowns: 0
Media and Data Integrity Errors: 0
Error Information Log Entries: 260
Warning Comp. Temperature Time: 771
Critical Comp. Temperature Time: 0
Temperature Sensor 1: 91 Celsius
Temperature Sensor 2: 93 Celsius
Temperature Sensor 3: 93 Celsius
Error Information (NVMe Log 0x01, 16 of 32 entries)
No Errors Logged
Self-tests not supported
admin@truenas[/dev]$ sudo smartctl -a /dev/nvme3
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.1.74-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Number: 4.8 TB NVMe G3 Tier-1 Flash
Serial Number: 01EK233YS1BBG99L07J
Firmware Version: 1_2_12
PCI Vendor/Subsystem ID: 0x1014
IEEE OUI Identifier: 0x005076
Total NVM Capacity: 21,990,232,555,520 [21.9 TB]
Unallocated NVM Capacity: 0
Controller ID: 0
NVMe Version: 1.3
Number of Namespaces: 16
Local Time is: Thu Apr 18 17:38:55 2024 EDT
Firmware Updates (0x02): 1 Slot
Optional Admin Commands (0x000f): Security Format Frmw_DL NS_Mngmt
Optional NVM Commands (0x006c): DS_Mngmt Wr_Zero Resv Timestmp
Log Page Attributes (0x08): Telmtry_Lg
Maximum Data Transfer Size: 512 Pages
Warning Comp. Temp. Threshold: 85 Celsius
Critical Comp. Temp. Threshold: 95 Celsius
Supported Power States
St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat
0 + 0.00W - - 0 0 0 0 0 0
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
SMART/Health Information (NVMe Log 0x02)
Critical Warning: 0x02
Temperature: 94 Celsius
Available Spare: 100%
Available Spare Threshold: 10%
Percentage Used: 0%
Data Units Read: 750,959,271 [384 TB]
Data Units Written: 782,021,484 [400 TB]
Host Read Commands: 6,143,819,693
Host Write Commands: 8,389,350,713
Controller Busy Time: 46,077
Power Cycles: 26
Power On Hours: 36,796
Unsafe Shutdowns: 0
Media and Data Integrity Errors: 0
Error Information Log Entries: 113
Warning Comp. Temperature Time: 780
Critical Comp. Temperature Time: 0
Temperature Sensor 1: 92 Celsius
Temperature Sensor 2: 94 Celsius
Temperature Sensor 3: 91 Celsius
Error Information (NVMe Log 0x01, 16 of 32 entries)
No Errors Logged
Self-tests not supported
Here is an updated output after creating the namespace for nvme4 & 5.
admin@truenas[~]$ sudo lsblk
[sudo] password for admin:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 1.1T 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 512M 0 part
├─sda3 8:3 0 1.1T 0 part
└─sda4 8:4 0 16G 0 part
└─sda4 253:0 0 16G 0 crypt [SWAP]
sdb 8:16 1 0B 0 disk
nvme0n1 259:0 0 20T 0 disk
nvme1n1 259:1 0 20T 0 disk
nvme2n1 259:2 0 20T 0 disk
nvme4n1 259:3 0 20T 0 disk
nvme5n1 259:4 0 20T 0 disk
nvme3n1 259:5 0 20T 0 disk
Okay. And when you are in the UI and try to make a pool it still says
Have you rebooted since fixing the name spaces?
This theoretically should be enough, but a reboot may be required.
nvme attach-ns /dev/nvme4 --namespace-id=1 -controllers=0
Yes I still get the same message, and have rebooted as well …
Not sure what else to try…
Tried to create a mirror with nvme4 & nvme5, which are the two I just created new namespace and same error.
I do not find much about these drives, but here is a link where some IBM guys are speaking about it, so maybe they are useless to a regualr system.