Gone for the weekend, returned to pool missing, possible drive failure, no idea what to do

Okay, I put the failed disk back in and restarted so I have the original 10 drives plus one spare. I ran both commands and this is what I got.

You should get at least firmware 16.00.12.00 for the 9300 series.
13.00.00.00 is rather dated.

Does your card have two controllers? Doublecheck with sudo sas3flash -listall

45drives has an article on how to update it, I see no reason why you can’t use it:

1 Like

What we now need to do is to try some import commands in “don’t actually try to import it but tell me what would happen if we did try it for real” mode (-n):

  • sudo zpool import -R /mnt -nF Valkyrie
  • sudo zpool import -R /mnt -nfF Valkyrie

and a diagnostic command:

  • for disk in /dev/sd?2; do; sudo zdb -l $disk; done

Hopefully after this we will be able to determine what to try to do an actual import.

P.S. @neofusion makes a good point about firmware levels - what I am not sure about is whether it is better to do this firmware upgrade now or to wait until we have the pool recovered.

Only one controller.

I did the two import commands.
image

But I got nothing indicating anything was done. Then I put in the diagnostic command and this is what I got back:

root@bigtruenas[~]# for disk in /dev/sd?2; do; sudo zdb -l $disk; done
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 17119780021793886840
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 3006882281538507282
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 2296139040122006835
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3003120
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 6524818153576139299
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 17617450205283552828
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 15271541350893828723
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 10225035552399033554
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083514
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 1735524699209308495
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750182893
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Valkyrie'
    state: 0
    txg: 3083521
    pool_guid: 14937449896484207154
    errata: 0
    hostid: 1631020594
    hostname: 'bigtruenas'
    top_guid: 18067475686433984793
    guid: 16359988943227625139
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 18067475686433984793
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 139983671787520
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 16359988943227625139
            path: '/dev/sda2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@1/elmdesc@Slot_00/p2'
            DTL: 70100
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 7101089285928253376
            path: '/dev/sdb2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@2/elmdesc@Slot_01/p2'
            DTL: 70099
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 10225035552399033554
            path: '/dev/sdd2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@3/elmdesc@Slot_02/p2'
            DTL: 70098
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 1735524699209308495
            path: '/dev/sde2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@4/elmdesc@Slot_03/p2'
            DTL: 70097
            create_txg: 4
            expansion_time: 1750202240
            removed: 1
        children[4]:
            type: 'disk'
            id: 4
            guid: 15271541350893828723
            path: '/dev/sdc2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 70096
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 17617450205283552828
            path: '/dev/sdg2'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 70095
            create_txg: 4
        children[6]:
            type: 'disk'
            id: 6
            guid: 3006882281538507282
            path: '/dev/sdh2'
            DTL: 70094
            create_txg: 4
        children[7]:
            type: 'disk'
            id: 7
            guid: 17119780021793886840
            path: '/dev/sdj2'
            DTL: 70093
            create_txg: 4
        children[8]:
            type: 'disk'
            id: 8
            guid: 2296139040122006835
            path: '/dev/sdf2'
            DTL: 70092
            create_txg: 4
        children[9]:
            type: 'disk'
            id: 9
            guid: 6524818153576139299
            path: '/dev/sdi2'
            DTL: 70091
            create_txg: 4
            faulted: 1
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
    labels = 0 1 2 3 
root@bigtruenas[~]# 

Thanks, if the 9305 is the newer one with the single controller I am not sure the previous link to 45drives applies…

This appears more suitable and links directly to the firmware package from Broadcom:
https://www.reddit.com/r/unRAID/comments/1ihwkvr/troubles_updating_fw_on_lsi_930516i_sas3flash/

Okay, I may need a little help figuring out how to install this. The package is for a windows machine 9305_16i_Pkg_P16.12_IT_FW_BIOS_for_MSDOS_Windows. I’m not sure what I should do with this. I see that there is a file with a .bin extension within the zip package in the firmware folder called SAS9306_16i_IT_P.bin. Do I use sas3flash to flash that to the card?

Personally I’d focus on what @Protopia is saying for now.

We can update the firmware on the hba afterwards imo…

The two commands returning nothing ( if not mistaken) is showing that things shouldn’t error out if those commands were run for real.

1 Like

Okay, so I’ve tried running it w/o the -n and I got the following:

Wait, the first command did not return any error… What does zpool list return?..

In the above, I had the old drive that wasn’t working connected initially.
Then I unplugged it and I get the message about /dev/sde/
Then I run them again with it plugged and I get this. (I could hear the drives doing something when I pressed enter)

@HoneyBadger - I’m thinking this is a mission for you. Any reason why raidz2 pool is failing to import with only a single dead drive?

@msarles I appreciate that you are both frustrated and keen to get your pool back online, but please read and do what is said and stop taking the initiative to try things like removing the -n flag and then running multiple attempts because you are not knowledgeable enough to interpret the output and check what has happened.

And then you made some hardware changes which would have required reboots, so goodness knows what the current state is.

I suspect that the first of these attempts sudo zpool import -R /mnt -F Valkyrie may have worked. The following ones then gave errors because the pool was then successfully imported. But this may not be the case.

So can you please now do as @Fleshmauler requested and run the following commands and post the results here each in a separate </> box:

  • /sbin/zpool status -vLtsc lsblk,serial,smartx,smart Valkyrie
  • /sbin/zpool list -vL Valkyrie
  • sudo zpool import

And please do NOT reboot or make any other changes!!

1 Like

I am not sure that this is true - it looks to me like it was importing - but actions taken by OP after that may have reversed this and possibly made things worse.

I think we need to establish the current state and see if we can get it to import with e.g. -F and then refer to @honeybadger if it needs his expertise.

1 Like

root@bigtruenas[~]# /sbin/zpool list -vL Valkyrie
cannot open 'Valkyrie': no such pool
root@bigtruenas[~]# sudo zpool import
  pool: Valkyrie
    id: 14937449896484207154
 state: ONLINE
status: One or more devices were being resilvered.
action: The pool can be imported using its name or numeric identifier.
config:

        Valkyrie    ONLINE
          raidz2-0  ONLINE
            sdj2    ONLINE
            sdk2    ONLINE
            sdg2    ONLINE
            sdi2    ONLINE
            sdf2    ONLINE
            sde2    ONLINE
            sdc2    ONLINE
            sda2    ONLINE
            sdd2    ONLINE
            sdb2    ONLINE
root@bigtruenas[~]#   

Thank you for your guidance and thank you for reminding me that I really don’t have any clue what I’m doing and I will only do what you all tell me. I don’t want this to fail. Thank you and I’m sorry for trying stuff I don’t understand.

Now first thing assuming it all works and it should, get your backups going!

Let’s see the contents of tail -n 200 /proc/spl/kstat/zfs/dbgmsg after those failed imports. Should hopefully be far enough back to glean something.

Theorycrafting below, be ye warned.

	Line   8:     txg: 3083521
	Line 116:     txg: 3083521
	Line 224:     txg: 3083521
	Line 332:     txg: 3003120 <-- this is your FAILING_NOW drive
	Line 437:     txg: 3083521
	Line 545:     txg: 3083521
	Line 653:     txg: 3083521
	Line 761:     txg: 3083514 <-- this is the one that you unplugged
	Line 868:     txg: 3083521

Keep that previous sde “failing” drive plugged in for these attempts. Theorycrafting is that it’s trying to enter at txg: 3083521 but has some metadata challenges and it won’t rewind more than the first few because it has no redundancy to rebuild from until txg: 3083514 assuming that drive is present. The drive stuck at txg: 3003120 is effectively cooked though and has little value.

1 Like

Here it is:

Last login: Thu Jun 26 11:38:32 MDT 2025 on pts/2
root@bigtruenas[~]# tail -n 200 /proc/spl/kstat/zfs/dbgmsg
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff955126e64080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': best uberblock found for spa $import-ffff955126e64080-Valkyrie. txg 3083521
1750960751   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config untrusted): using uberblock with txg=3083521
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 16359988943227625139: vdev_path changed from '/dev/sda2' to '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 7101089285928253376: vdev_path changed from '/dev/sdb2' to '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 10225035552399033554: vdev_path changed from '/dev/sdd2' to '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 1735524699209308495: vdev_path changed from '/dev/sde2' to '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 15271541350893828723: vdev_path changed from '/dev/sdc2' to '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17617450205283552828: vdev_path changed from '/dev/sdg2' to '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 3006882281538507282: vdev_path changed from '/dev/sdh2' to '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17119780021793886840: vdev_path changed from '/dev/sdj2' to '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 2296139040122006835: vdev_path changed from '/dev/sdf2' to '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 6524818153576139299: vdev_path changed from '/dev/sdi2' to '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0'
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff9550c335a040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading checkpoint txg
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading indirect vdev metadata
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Checking feature flags
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading special MOS directories
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading properties
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading AUX vdevs
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading vdev metadata
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading dedup tables
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading BRT
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying Log Devices
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying pool data
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Calculating deflated space
1750960751   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Starting import
1750960751   ffff955126e64080 spa.c:9245:spa_async_request(): spa=$import-ffff955126e64080-Valkyrie async request task=2048
1750960751   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config trusted): LOADED
1750960751   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config trusted): UNLOADING
1750961010   ffff955124092040 metaslab.c:1687:spa_set_allocator(): spa allocator: dynamic
1750961010   ffff955124092040 spa.c:6928:spa_tryimport(): spa_tryimport: importing Valkyrie
1750961010   ffff955124092040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955124092040-Valkyrie, config trusted): LOADING
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955124092040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': best uberblock found for spa $import-ffff955124092040-Valkyrie. txg 3083521
1750961010   ffff955124092040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955124092040-Valkyrie, config untrusted): using uberblock with txg=3083521
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 16359988943227625139: vdev_path changed from '/dev/sda2' to '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 7101089285928253376: vdev_path changed from '/dev/sdb2' to '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 10225035552399033554: vdev_path changed from '/dev/sdd2' to '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 1735524699209308495: vdev_path changed from '/dev/sde2' to '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 15271541350893828723: vdev_path changed from '/dev/sdc2' to '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17617450205283552828: vdev_path changed from '/dev/sdg2' to '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 3006882281538507282: vdev_path changed from '/dev/sdh2' to '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17119780021793886840: vdev_path changed from '/dev/sdj2' to '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 2296139040122006835: vdev_path changed from '/dev/sdf2' to '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955124092040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 6524818153576139299: vdev_path changed from '/dev/sdi2' to '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955083220000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading checkpoint txg
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading indirect vdev metadata
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Checking feature flags
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading special MOS directories
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading properties
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading AUX vdevs
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading vdev metadata
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading dedup tables
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading BRT
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying Log Devices
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying pool data
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Calculating deflated space
1750961010   ffff955124092040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Starting import
1750961010   ffff955124092040 spa.c:9245:spa_async_request(): spa=$import-ffff955124092040-Valkyrie async request task=2048
1750961010   ffff955124092040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955124092040-Valkyrie, config trusted): LOADED
1750961010   ffff955124092040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955124092040-Valkyrie, config trusted): UNLOADING
1750961060   ffff955126e64080 metaslab.c:1687:spa_set_allocator(): spa allocator: dynamic
1750961060   ffff955126e64080 spa.c:6928:spa_tryimport(): spa_tryimport: importing Valkyrie
1750961060   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config trusted): LOADING
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff955126e64080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': best uberblock found for spa $import-ffff955126e64080-Valkyrie. txg 3083521
1750961060   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config untrusted): using uberblock with txg=3083521
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 16359988943227625139: vdev_path changed from '/dev/sda2' to '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 7101089285928253376: vdev_path changed from '/dev/sdb2' to '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 10225035552399033554: vdev_path changed from '/dev/sdd2' to '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 1735524699209308495: vdev_path changed from '/dev/sde2' to '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 15271541350893828723: vdev_path changed from '/dev/sdc2' to '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17617450205283552828: vdev_path changed from '/dev/sdg2' to '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 3006882281538507282: vdev_path changed from '/dev/sdh2' to '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17119780021793886840: vdev_path changed from '/dev/sdj2' to '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 2296139040122006835: vdev_path changed from '/dev/sdf2' to '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff955126e64080 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 6524818153576139299: vdev_path changed from '/dev/sdi2' to '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff9550a1e14080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading checkpoint txg
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading indirect vdev metadata
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Checking feature flags
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading special MOS directories
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading properties
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading AUX vdevs
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading vdev metadata
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading dedup tables
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading BRT
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying Log Devices
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying pool data
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Calculating deflated space
1750961060   ffff955126e64080 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Starting import
1750961060   ffff955126e64080 spa.c:9245:spa_async_request(): spa=$import-ffff955126e64080-Valkyrie async request task=2048
1750961060   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config trusted): LOADED
1750961060   ffff955126e64080 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126e64080-Valkyrie, config trusted): UNLOADING
1750961065   ffff955126b12040 metaslab.c:1687:spa_set_allocator(): spa allocator: dynamic
1750961065   ffff955126b12040 spa.c:6928:spa_tryimport(): spa_tryimport: importing Valkyrie
1750961065   ffff955126b12040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126b12040-Valkyrie, config trusted): LOADING
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955126b12040 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': best uberblock found for spa $import-ffff955126b12040-Valkyrie. txg 3083521
1750961065   ffff955126b12040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126b12040-Valkyrie, config untrusted): using uberblock with txg=3083521
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 16359988943227625139: vdev_path changed from '/dev/sda2' to '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 7101089285928253376: vdev_path changed from '/dev/sdb2' to '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 10225035552399033554: vdev_path changed from '/dev/sdd2' to '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 1735524699209308495: vdev_path changed from '/dev/sde2' to '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 15271541350893828723: vdev_path changed from '/dev/sdc2' to '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17617450205283552828: vdev_path changed from '/dev/sdg2' to '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 3006882281538507282: vdev_path changed from '/dev/sdh2' to '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 17119780021793886840: vdev_path changed from '/dev/sdj2' to '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 2296139040122006835: vdev_path changed from '/dev/sdf2' to '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955126b12040 vdev.c:2534:vdev_update_path(): vdev_copy_path: vdev 6524818153576139299: vdev_path changed from '/dev/sdi2' to '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0'
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acf0290-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8acb2119-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad7958b-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad52296-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad18cce-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8ad864b3-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b70da16-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b95c2a4-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b7c8d35-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955125580000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/8b67b979-b7f0-11ef-8e8c-0c9d921a8ea0': probe done, cant_read=0 cant_write=1
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading checkpoint txg
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading indirect vdev metadata
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Checking feature flags
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading special MOS directories
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading properties
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading AUX vdevs
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading vdev metadata
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading dedup tables
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Loading BRT
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying Log Devices
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Verifying pool data
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Calculating deflated space
1750961065   ffff955126b12040 spa_misc.c:2376:spa_import_progress_set_notes_impl(): 'Valkyrie' Starting import
1750961065   ffff955126b12040 spa.c:9245:spa_async_request(): spa=$import-ffff955126b12040-Valkyrie async request task=2048
1750961065   ffff955126b12040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126b12040-Valkyrie, config trusted): LOADED
1750961065   ffff955126b12040 spa_misc.c:429:spa_load_note(): spa_load($import-ffff955126b12040-Valkyrie, config trusted): UNLOADING
root@bigtruenas[~]# 

Thank you!

Did you not have cable ties in the old days?

:wink: