Core 13.0-U4 can't swap drive

Tim_Gross · February 6, 2025, 10:45pm

I have a failed drive. I set it to offline. Shutdown truenas. Put in new drive, booted up but dont see it when i use the pool / replace gui menu item. Help?

NAME                                            STATE     READ WRITE CKSUM
vdev12x6TB                                      DEGRADED     0     0     0
  raidz2-0                                      DEGRADED     0     0     0
    gptid/b216af99-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    6977617370305460568                         OFFLINE      0     0     0  was /dev/gptid/b20dd741-f896-11ed-8a74-001086801d6c
    gptid/b19b5182-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1028913-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1a4ba67-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b2314850-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1fcf761-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1ad4a7c-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b2289653-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b192394b-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b205f0b1-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b21f99cd-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0

errors: No known data errors
root@Genesis2[~]# gpart list
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 62533255
first: 40
entries: 128
scheme: GPT
Providers:

Name: ada0p1
Mediasize: 524288 (512K)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 20480
Mode: r0w0e0
efimedia: HD(1,GPT,9ad7c27e-f890-11ed-8af3-001086801d6c,0x28,0x400)
rawuuid: 9ad7c27e-f890-11ed-8af3-001086801d6c
rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
label: (null)
length: 524288
offset: 20480
type: freebsd-boot
index: 1
end: 1063
start: 40
Name: ada0p2
Mediasize: 32010928128 (30G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 544768
Mode: r1w1e1
efimedia: HD(2,GPT,9adab41d-f890-11ed-8af3-001086801d6c,0x428,0x3ba0000)
rawuuid: 9adab41d-f890-11ed-8af3-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 32010928128
offset: 544768
type: freebsd-zfs
index: 2
end: 62522407
start: 1064
Consumers:
Name: ada0
Mediasize: 32017047552 (30G)
Sectorsize: 512
Mode: r1w1e2

Geom name: da2
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da2p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r0w0e0
efimedia: HD(1,GPT,b04b905e-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b04b905e-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da2p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b1028913-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b1028913-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da2
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e3

Geom name: da5
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da5p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r0w0e0
efimedia: HD(1,GPT,b0e96dfb-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0e96dfb-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da5p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b1fcf761-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b1fcf761-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da5
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e3

Geom name: da8
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da8p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0654c98-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0654c98-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da8p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b192394b-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b192394b-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da8
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da0p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0d83acf-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0d83acf-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da0p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b216af99-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b216af99-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da0
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da9
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da9p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0d002b6-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0d002b6-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da9p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b205f0b1-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b205f0b1-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da9
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da10
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da10p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0f1c1b0-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0f1c1b0-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da10p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b21f99cd-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b21f99cd-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da10
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da7
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da7p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0fa9c4e-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0fa9c4e-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da7p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b2289653-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b2289653-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da7
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da6
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da6p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b077187c-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b077187c-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da6p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b1ad4a7c-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b1ad4a7c-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da6
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da4
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da4p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b0e11fc9-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b0e11fc9-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da4p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b2314850-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b2314850-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da4
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da1p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b07fc6ae-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b07fc6ae-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da1p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b19b5182-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b19b5182-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da1
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da3
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 11721045127
first: 40
entries: 128
scheme: GPT
Providers:

Name: da3p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,b06e2eee-f896-11ed-8a74-001086801d6c,0x80,0x400000)
rawuuid: b06e2eee-f896-11ed-8a74-001086801d6c
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
Name: da3p2
Mediasize: 5999027556352 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,b1a4ba67-f896-11ed-8a74-001086801d6c,0x400080,0x2ba60f408)
rawuuid: b1a4ba67-f896-11ed-8a74-001086801d6c
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 5999027556352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 11721045127
start: 4194432
Consumers:
Name: da3
Mediasize: 6001175126016 (5.5T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

root@Genesis2[~]#
root@Genesis2[~]#
root@Genesis2[~]#
root@Genesis2[~]# zpool status
pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:05 with 0 errors on Wed Feb 5 03:45:05 2025
config:

NAME        STATE     READ WRITE CKSUM
boot-pool   ONLINE       0     0     0
  ada0p2    ONLINE       0     0     0

errors: No known data errors

pool: vdev12x6TB
state: DEGRADED
status: One or more devices could not be opened. Sufficient replicas exist for
the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using ‘zpool online’.
see: Message ID: ZFS-8000-2Q — OpenZFS documentation
scan: scrub in progress since Thu Feb 6 06:01:08 2025
10.2T scanned at 2.76G/s, 6.85T issued at 1.86G/s, 40.3T total
0B repaired, 17.00% done, 05:07:14 to go
config:

NAME                                            STATE     READ WRITE CKSUM
vdev12x6TB                                      DEGRADED     0     0     0
  raidz2-0                                      DEGRADED     0     0     0
    gptid/b216af99-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    6977617370305460568                         UNAVAIL      0     0     0  was /dev/gptid/b20dd741-f896-11ed-8a74-001086801d6c
    gptid/b19b5182-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1028913-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1a4ba67-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b2314850-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1fcf761-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b1ad4a7c-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b2289653-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b192394b-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b205f0b1-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0
    gptid/b21f99cd-f896-11ed-8a74-001086801d6c  ONLINE       0     0     0

errors: No known data errors
root@Genesis2[~]#

Tim_Gross · February 6, 2025, 10:54pm

Truenas GUI never shows me New Member Disk when using the STORAGE/POOLS/STATUS/…(context menu)/REPLACE

Is my drive not recognized due to cable/backplance connector? This connector has been working uptill drive failure?

Is my new/used replacement drive have an odd Partition table type that TrueNAS doesn’t like?

How to get new drives to show up in the REPLACE/MEMBER DISKS (drop down menu)?

Tim_Gross · February 15, 2025, 7:05am

To answer my own problem. When you add a new drive to this system that had an Avago/Brocade 9431 card it will show up as foreign or unknown. You need to go into the SAS’s cards bios menus to “CLEAR” the drive and then TrueNAS core and TrueNAS Scale (yes i tested both) will then allow you to utilize the drive.

Tim_Gross · February 15, 2025, 7:07am

Feature request to the TrueNAS team. Do a deeper integration with the major SAS HBA cards. Dont just stop at degraded. And or give. us a feature to wipe/format the new drive; clear the foreign status etc.

Johnny_Fartpants · February 15, 2025, 7:35am

Hi, at a glance it looks like the 9341 is a RAID card and this would make sense regarding your issue. I’m not sure it’s possible with that particular card but you would want to put it in IT mode or buy a HBA that is supported. Using HW RAID with TrueNAS can cause damage to your data so tread carefully.