Unsure of next steps after exported pool

TrueNAS General
, ,
1

Hi all,

Truenas scale running well for months.

I’ve logged in today to find my pool has been exported. I suspect a hardware failure of one of the disks (most likely) but am unsure of how to move forward.

When I try and import the pool it doesn’t show up.

I have run smart tests on the disks which pass.

When I run import pool via shell I get this:

root@truenas[~J# zpool import
pool:
Swimming
id: 14467692675057611316
state: ONLINE status:
Some supported features are not enabled on the pool.
(Note that they may be intentionally disabled if the
‘compatibility’ property is set.)
action: The pool can be imported using its name or numeric identifier
though
some features will not be available without an explicit ‘zpool upgrade’.
config:
Swimming
ONLINE
mirror-0
ONLINE
fb6f49c6-1e82-11ef-8411-d017c2d255f8
ONLINE
fb51160e-1e82-11ef-8411-d017c2d255f8
ONLINE
mirror-1
ONLINE
6db758c7-9dc0-41f4-9dd5-5f1e088efda0
ONLINE
ab18a756-c9bd-4a55-9a29-71f957e52526
ONLINE
root@truenas[-J# zpool import 14467692675057611316
cannot import
‘Swimming’: one or more devices is currently unavailable

I’d really like to not lose the data on the drives (ofc) but it’s fairly unclear how to move forward here without delete the data and starting again. (happy to buy a new drive)

Can anyone point me in the right direction? Many thanks in advance.

2

Just use

zpool import
Without the pools name. It will show you more details.

3

What do you get from this?

It’s a single command written as multiple lines.

for dev in {fb6f49c6-1e82-11ef-8411-d017c2d255f8,\
fb51160e-1e82-11ef-8411-d017c2d255f8,\
6db758c7-9dc0-41f4-9dd5-5f1e088efda0,\
ab18a756-c9bd-4a55-9a29-71f957e52526\
};
do zdb -l /dev/disk/by-partuuid/$dev | grep -E ^"    "txg;
done
4

And please use formatted text (</> button) when posting from the shell.

2 Likes
5

txg: 5110106
txg: 5110106
txg: 5110106
txg: 5110106

6 
root@truenas[~]# zpool import
  pool: Swimming
    id: 14467692675057611316
 state: ONLINE
status: Some supported features are not enabled on the pool.
        (Note that they may be intentionally disabled if the
        'compatibility' property is set.)
action: The pool can be imported using its name or numeric identifier, though
        some features will not be available without an explicit 'zpool upgrade'.
config:

        Swimming                                  ONLINE
          mirror-0                                ONLINE
            fb6f49c6-1e82-11ef-8411-d017c2d255f8  ONLINE
            fb51160e-1e82-11ef-8411-d017c2d255f8  ONLINE
          mirror-1                                ONLINE
            6db758c7-9dc0-41f4-9dd5-5f1e088efda0  ONLINE
            ab18a756-c9bd-4a55-9a29-71f957e52526  ONLINE
7 
root@truenas[~]# zpool import
  pool: Swimming
    id: 14467692675057611316
 state: ONLINE
status: Some supported features are not enabled on the pool.
        (Note that they may be intentionally disabled if the
        'compatibility' property is set.)
action: The pool can be imported using its name or numeric identifier, though
        some features will not be available without an explicit 'zpool upgrade'.
config:

        Swimming                                  ONLINE
          mirror-0                                ONLINE
            fb6f49c6-1e82-11ef-8411-d017c2d255f8  ONLINE
            fb51160e-1e82-11ef-8411-d017c2d255f8  ONLINE
          mirror-1                                ONLINE
            6db758c7-9dc0-41f4-9dd5-5f1e088efda0  ONLINE
            ab18a756-c9bd-4a55-9a29-71f957e52526  ONLINE
root@truenas[~]# zpool import 14467692675057611316
cannot import 'Swimming': one or more devices is currently unavailable

If I then try this I get…

8

It says devices are missing. So what devices are missing ?

9

That’s the problem. Everything seems reasonable to me?

root@truenas[~]# lsblk                                    
NAME        MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
sda           8:0    0   3.6T  0 disk 
└─sda1        8:1    0   3.6T  0 part 
sdb           8:16   0   3.6T  0 disk 
└─sdb1        8:17   0   3.6T  0 part 
sdc           8:32   0   4.5T  0 disk 
└─sdc1        8:33   0   4.5T  0 part 
sdd           8:48   0  12.7T  0 disk 
├─sdd1        8:49   0     2G  0 part 
└─sdd2        8:50   0  12.7T  0 part 
sde           8:64   0  12.7T  0 disk 
├─sde1        8:65   0     2G  0 part 
└─sde2        8:66   0  12.7T  0 part 
nvme0n1     259:0    0 238.5G  0 disk 
├─nvme0n1p1 259:1    0     1M  0 part 
├─nvme0n1p2 259:2    0   512M  0 part 
└─nvme0n1p3 259:3    0   238G  0 part

That swimming pool is made up for 2 x 3.6tb and 2 x 12.7tb drives

10

What about that 4.5 T disc sdc ?

11

That’s some other disc I just use for time machine backups. Just a single drive. “Drowing” is the name of that pool and it’s working just fine.

12

After the zpool import failure please show me the last 100-200 lines or so of the file

/proc/spl/kstat/zfs/dbgmsg

you can tail -n 200 the output to a file if it’s easier.

I’d also like to see a full zdb -l output for one of those partitions, but without the | grep afterwards, so just the zdb -l /dev/disk/by-partuuid/$dev piece.

Both results unfiltered and in codeblocks please.

4 Likes
13

Nothing happens after zpool import

root@truenas[~]# zpool import
pool: Swimming
id: 14467692675057611316
state: ONLINE
status: Some supported features are not enabled on the pool.
(Note that they may be intentionally disabled if the
‘compatibility’ property is set.)
action: The pool can be imported using its name or numeric identifier, though
some features will not be available without an explicit ‘zpool upgrade’.
config:

    Swimming                                  ONLINE
      mirror-0                                ONLINE
        fb6f49c6-1e82-11ef-8411-d017c2d255f8  ONLINE
        fb51160e-1e82-11ef-8411-d017c2d255f8  ONLINE
      mirror-1                                ONLINE
        6db758c7-9dc0-41f4-9dd5-5f1e088efda0  ONLINE
        ab18a756-c9bd-4a55-9a29-71f957e52526  ONLINE

If I run zpool import 14467692675057611316

I just get:

cannot import 'Swimming': one or more devices is currently unavailable
14

You’re missing two requested commands.

Here’s one:

Here’s the other:
zdb -l /dev/disk/by-partuuid/fb6f49c6-1e82-11ef-8411-d017c2d255f8

1 Like
15 
root@truenas[~]# zdb -l /dev/disk/by-partuuid/fb6f49c6-1e82-11ef-8411-d017c2d255f8
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'Swimming'
    state: 0
    txg: 5110106
    pool_guid: 14467692675057611316
    errata: 0
    hostid: 1561967168
    hostname: 'truenas'
    top_guid: 12222858812750431150
    guid: 11688416868481953668
    vdev_children: 2
    vdev_tree:
        type: 'mirror'
        id: 0
        guid: 12222858812750431150
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 13998367178752
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 11688416868481953668
            path: '/dev/disk/by-partuuid/fb6f49c6-1e82-11ef-8411-d017c2d255f8'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
            DTL: 32959
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 8159751455144588494
            path: '/dev/disk/by-partuuid/fb51160e-1e82-11ef-8411-d017c2d255f8'
            phys_path: 'id1,enc@n3061686369656d30/type@0/slot@6/elmdesc@Slot_05/p2'
            DTL: 32958
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3

As mentioned above, there is no failure (100/200 lines) after zpool import. It just talks about unsupported features.

root@truenas[~]# zpool import
  pool: Swimming
    id: 14467692675057611316
 state: ONLINE
status: Some supported features are not enabled on the pool.
        (Note that they may be intentionally disabled if the
        'compatibility' property is set.)
action: The pool can be imported using its name or numeric identifier, though
        some features will not be available without an explicit 'zpool upgrade'.
config:

        Swimming                                  ONLINE
          mirror-0                                ONLINE
            fb6f49c6-1e82-11ef-8411-d017c2d255f8  ONLINE
            fb51160e-1e82-11ef-8411-d017c2d255f8  ONLINE
          mirror-1                                ONLINE
            6db758c7-9dc0-41f4-9dd5-5f1e088efda0  ONLINE
            ab18a756-c9bd-4a55-9a29-71f957e52526  ONLINE