Need help with missing pool

etorix · June 8, 2025, 8:33am

It can take a lot more than ten minutes, and since this is a dry run we are really interested in seeing the output, if any of the command. Try again in a tmux session.
Tmux is a complicated beast, but we can keep it simple. Type tmux. Type sudo zpool import -FXn pool. If you evr get disconnected, type tmux attach to return to the unnamed session.

svag · June 8, 2025, 9:20am

Снимок экрана 2025-06-08 121739
thats all.
am i doing smth wrong?

Arwen · June 8, 2025, 10:34am

I don’t know why the pool won’t import with a missing disk, when their is enough redundancy still available.

It is possible their is more damage that I can see.

The output -FXn option does appear hopeful. However, data loss is to be expected using -X.

To be clear, when these types of problems occur, and rolling back transactions seems to be the only recourse, data loss should be limited to extremely recent writes. Meaning any much older data should be fine. The pool still has parity, (a 4 disk RAID-Z2 missing 1 disk, still has 1 disk of redundancy).

Now I will have to defer to others on why this pool won’t import.

svag · June 8, 2025, 10:51am

tried again. no output

svag · June 8, 2025, 10:52am

There was a lot of chksum errors before this happend cause of power supply issue.
maybe the time has come for this: sudo zpool import -FX pool ? =)
i dont anderstant what kind of output must be afte dryrun.

neofusion · June 8, 2025, 11:36am

No outpot after the completed dryrun is ideal.

But you really need to run it in tmux as has been mentioned a few times when it’s not a dryrun because your shell will almost certainly be closed before it finishes. Plus you appear to have severe power or networking issues that make connections especially unreliable.

etorix · June 8, 2025, 4:29pm

The dry run return quickly with no error message? That means ZFS would be able to import. The “quick” part is puzzling, as we’d expect to wait quite some time while ZFS rewinds and checks at which point it can import.

In an other thread, @HoneyBadger asked for

the contents of /proc/spl/kstat/zfs/dbgmsg immediately following the zpool import command.

and it may be worth checking here as well.
Pending that, if you accept the risk of losing some recent transactions, the next step would be
sudo zpool import -R /mnt -fFX pool
Always add -R /mnt to any real import to mount the pool in the right place.

svag · June 8, 2025, 5:57pm

admin@truenas[~]$ sudo zpool import -R /mnt -fFX  pool
[sudo] password for admin: 
cannot import 'pool': one or more devices is currently unavailable
admin@truenas[~]$

1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847853
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847853
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847853)
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847853
1749408696   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847852
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847852
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847852)
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847852
1749408696   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847851
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847851
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847851)
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847851
1749408696   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847850
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847849
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847849)
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847849
1749408696   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847848
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847847
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847847)
1749408696   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408696   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847847
1749408697   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847846
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847846
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847846)
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847846
1749408697   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847845
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847845
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847845)
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847845
1749408697   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=52]
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847844
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847844
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847844)
1749408697   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408697   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847844
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading checkpoint txg
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading indirect vdev metadata
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Checking feature flags
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading special MOS directories
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading properties
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading AUX vdevs
1749408697   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading vdev metadata
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config trusted): FAILED: spa_ld_log_sm_metadata(): failed at zap_cursor_retrieve(spacemap_zap) [error 52]
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config trusted): FAILED: spa_ld_log_spacemaps failed [error=52]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): spa_load_retry: rewind, max txg: 8847843
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847843
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847843)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847843
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading checkpoint txg
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading indirect vdev metadata
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Checking feature flags
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading special MOS directories
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading properties
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading AUX vdevs
1749408699   spa_misc.c:2311:spa_import_progress_set_notes_impl(): 'pool' Loading vdev metadata
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config trusted): FAILED: spa_ld_log_sm_metadata(): failed at zap_cursor_retrieve(spacemap_zap) [error 52]
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config trusted): FAILED: spa_ld_log_spacemaps failed [error=52]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): spa_load_retry: rewind, max txg: 8847842
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config trusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847842
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847842)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847842
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=52]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847841
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847840
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847840)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847840
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847839
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847839
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847839)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847839
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847838
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847838
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847838)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847838
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847837
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847837
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847837)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847837
1749408699   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=52]
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847836
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847836
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847836)
1749408699   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408699   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847836
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847835
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847835
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847835)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847835
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847834
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847830
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847830)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847830
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=52]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847829
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847829
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847829)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847829
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847828
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847828
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847828)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847828
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847827
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847825
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847825)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847825
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847824
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847824
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847824)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847824
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847823
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847821
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847821)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847821
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847820
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847819
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847819)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847819
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847818
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847818
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847818)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847818
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847817
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847817
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847817)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847817
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847816
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': best uberblock found for spa pool. txg 8847816
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': label discarded as txg is too large (8847875 > 8847816)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/7148f5b2-5cf3-4f20-8f67-3e13d6350289': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847816
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847815
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847809
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847809)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847809
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847808
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847808
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847808)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847808
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847807
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847794
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847794)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847794
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847793
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847791
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847791)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847791
1749408700   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to open rootbp in dsl_pool_init [error=5]
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847790
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847790
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847790)
1749408700   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408700   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847790
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847789
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847788
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847788)
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847788
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847787
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847770
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847770)
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847770
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847769
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': best uberblock found for spa pool. txg 8847769
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': label discarded as txg is too large (8847875 > 8847769)
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/83c95c75-7fe2-4fec-9845-d974fc3f637f': failed to read label config. Trying again without txg restrictions.
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847769
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847768
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847767
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847767)
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847767
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847766
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': best uberblock found for spa pool. txg 8847763
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': label discarded as txg is too large (8847849 > 8847763)
1749408701   vdev.c:161:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/af598827-99d2-46cc-bb20-e3821e34ca31': failed to read label config. Trying again without txg restrictions.
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): using uberblock with txg=8847763
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: unable to retrieve MOS config
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): spa_load_retry: rewind, max txg: 8847762
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): LOADING
1749408701   spa_misc.c:404:spa_load_failed(): spa_load(pool, config untrusted): FAILED: no valid uberblock found
1749408701   spa_misc.c:418:spa_load_note(): spa_load(pool, config untrusted): UNLOADING`Preformatted text`

svag · June 8, 2025, 5:58pm

root@truenas[/home/admin]# lsblk -o name,size,type,partuuid            
NAME          SIZE TYPE  PARTUUID
sda         223.6G disk  
├─sda1          1M part  0bfe2fd4-c7c6-48f7-95c3-9ac97455137b
├─sda2        512M part  c2e55895-c266-48e3-a249-8574d9502604
├─sda3      207.1G part  a8ca35d1-8aef-4b47-8784-68848999cfe0
└─sda4         16G part  ef366a6b-d331-4d0b-a08b-9c6e73abe626
sdb           3.6T disk  
├─sdb1          2G part  9ee250cd-dccf-494c-aab3-1f2cc2fbd84c
│ └─md127       2G raid1 
│   └─md127     2G crypt 
└─sdb2        3.6T part  7148f5b2-5cf3-4f20-8f67-3e13d6350289
sdc           3.6T disk  
├─sdc1          2G part  a4722b12-5b0f-476d-a704-7f384653ad21
│ └─md127       2G raid1 
│   └─md127     2G crypt 
└─sdc2        3.6T part  78768fa5-a92a-4548-9557-0f42401ccccf
sdd           3.6T disk  
├─sdd1          2G part  9f7ed069-5e4e-4b7f-a806-5f9e40047067
│ └─md127       2G raid1 
│   └─md127     2G crypt 
└─sdd2        3.6T part  af598827-99d2-46cc-bb20-e3821e34ca31
sde           3.6T disk  
├─sde1          2G part  02b02130-2f0b-415f-ae8c-85d849261c33
└─sde2        3.6T part  83c95c75-7fe2-4fec-9845-d974fc3f637f

svag · June 9, 2025, 4:27am

i suppose this is the last chance? still not try it like that

svag · June 9, 2025, 4:34am

can it be some buggy output and the real reason import fails is not the unavailable hdd? There was a lot of checksum errors before the pool is gone. maybe there is action with some file similar to zpool clear?
is it important that there was (i suppose) one vdev contains all 4 sdX?
here is the thread that looks exactly like my case (not shure about DISKS screen) except the global reason.
as a guess i can purpose that there is backplane issue, so ill try to boot at the different hardware and\or connect sdX directly to the MB.
upd.
Here is some last errors before i changed power unit
pool/.system/cores:<0x4607>
pool/.system/cores:<0x451e>
pool/.system/cores:<0x4527>
pool/.system/cores:<0x4682>
pool/.system/cores:<0x4685>
…
found the list of corrupted files.

svag · June 9, 2025, 7:25am

root@truenas[/home/admin]# zpool import
   pool: pool
     id: 13997916364281612929
  state: ONLINE
status: Some supported features are not enabled on the pool.
        (Note that they may be intentionally disabled if the
        'compatibility' property is set.)
 action: The pool can be imported using its name or numeric identifier, though
        some features will not be available without an explicit 'zpool upgrade'.
 config:

        pool                                      ONLINE
          raidz2-0                                ONLINE
            7148f5b2-5cf3-4f20-8f67-3e13d6350289  ONLINE
            78768fa5-a92a-4548-9557-0f42401ccccf  ONLINE
            af598827-99d2-46cc-bb20-e3821e34ca31  ONLINE
            83c95c75-7fe2-4fec-9845-d974fc3f637f  ONLINE
root@truenas[/home/admin]# 
root@truenas[/home/admin]# 
root@truenas[/home/admin]# zpool import -R /mnt -F -X -T 8847849 pool
cannot import 'pool': one or more devices is currently unavailable
root@truenas[/home/admin]#

still no success. without backplane

Protopia · June 9, 2025, 7:57am

Try the following:

sudo zpool import -R /mnt -d /dev/disk/by-partuuid -fFX -T 8847849 pool

etorix · June 9, 2025, 7:58am

I understand from the above log that there are metadata errors going too far back in time for ZFS to find a txg it could import. If this is “only” in non-essential files within the system dataset it may not matter much, and there are tunables to tell ZFS to import anyway (in your original post, even) but this is deep in Hail Mary territory.

Reasonably, it’s time to destroy and restore from backup.

svag · June 9, 2025, 9:12am

all other files corrupted are from user data.

svag · June 9, 2025, 9:19am

root@truenas[/home/admin]# zpool import -R /mnt -d /dev/disk/by-partuuid -fFX -T 8847849 pool 
cannot import 'pool': one or more devices is currently unavailable
root@truenas[/home/admin]#

etorix · June 9, 2025, 4:01pm

While forsensics could be of academic interest, I think it’s time to get a new set of CMR drives and start again from the backup.

svag · June 12, 2025, 1:16pm

root@truenas[/home/admin]# echo 1 > /sys/module/zfs/parameters/zfs_max_missing_tvds
root@truenas[/home/admin]# echo 0 > /sys/module/zfs/parameters/spa_load_verify_metadata
root@truenas[/home/admin]# echo 0 > /sys/module/zfs/parameters/spa_load_verify_data 


root@truenas[/home/admin]#  zpool import -R /mnt -f -o readonly=on -F -X  pool
root@truenas[/home/admin]# zpool status
  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:19 with 0 errors on Fri May 30 03:45:20 2025
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          sde3      ONLINE       0     0     0

errors: No known data errors

  pool: pool
 state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: resilvered 2.63M in 00:00:03 with 0 errors on Sat Jun  7 12:13:07 2025
config:

        NAME                                      STATE     READ WRITE CKSUM
        pool                                      ONLINE       0     0     0
          raidz2-0                                ONLINE       0     0     0
            7148f5b2-5cf3-4f20-8f67-3e13d6350289  ONLINE       0     0     1
            78768fa5-a92a-4548-9557-0f42401ccccf  ONLINE       0     0     1
            af598827-99d2-46cc-bb20-e3821e34ca31  ONLINE       0     0    10
            83c95c75-7fe2-4fec-9845-d974fc3f637f  ONLINE       0     0     2

errors: 2 data errors, use '-v' for a list
root@truenas[/home/admin]#

So, at this time i can list files. not all of them, i suppose some of them corrupted, but its much better than before.

at this time what the proper and fastest way to copy available data?
external hdd connected directly to apliance? some advice\instructions?
first try to copy via WinSCP interrupted suddenly. at this time dont have enought statistic.
Appreciate any help

svag · June 12, 2025, 1:27pm

  pool: pool
 state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: resilvered 2.63M in 00:00:03 with 0 errors on Sat Jun  7 12:13:07 2025
config:

        NAME                                      STATE     READ WRITE CKSUM
        pool                                      ONLINE       0     0     0
          raidz2-0                                ONLINE       0     0     0
            7148f5b2-5cf3-4f20-8f67-3e13d6350289  ONLINE       0     0   411
            78768fa5-a92a-4548-9557-0f42401ccccf  ONLINE       0     0   411
            af598827-99d2-46cc-bb20-e3821e34ca31  ONLINE       0     0   418
            83c95c75-7fe2-4fec-9845-d974fc3f637f  ONLINE       0     0   410

upd. Listing files become chksum errors.
Is it safe to scrub them? or any ideas?