在win10通过smb整理文件时进度卡死,然后重启(从UI操作)之后挂载不上pool/Progress stuck while organizing files via smb in win10, then after reboot (operating from UI) the mount won't go on pool

在win10通过smb整理nas里的文件时进度卡死,然后重启(从UI操作)之后挂载不上pool,pool.import_on_boot和pool.dataset.sync_db_keys都是0%超过24小时,无奈之下我被迫关机让硬盘休息(他们的指示灯疯狂闪烁了一天)。

查阅社区文章后我做了一些尝试:
在原系统里shell 有关zpool的命令都无响应
关机拔下硬盘后开机再连接硬盘的情况下,命令zpool import 可用,全部硬盘的txg一致,SMART overall-health self-assessment test result: PASSED,但是使用import命令之后shell无回应,硬盘灯同时闪烁,8小时左右之后系统重启,然后情况依旧。
我试过升级版本到24.04.2.5和24.10.2.3和在新驱动全新安装24.10.2.3都无法顺利import.
尝试过的命令分别有 zpool import,zpool import -F,zpool import -f,zpool import -m -R /mnt/,zpool import -f -m -R /mnt/
期望能有人帮助,感谢

The progress jammed in Win10 while I was organizing files in NAS via SMB. Then, after rebooting from the UI, it wouldn’t mount the pool. Pool.import_on_boot and Pool.dataset.sync_db_keys were at 0% for more than 24 hours. I was forced to shut down and let the hard disks rest in a desperate attempt. Their lights blinked like crazy for a day.

After checking the community articles, I made some attempts.

In the original system, the shell commands for ZFS pools were unresponsive.

With the disks unplugged, powered off, and then reconnected, the command “zpool import” was available. The TXG of all the disks was consistent, SMART overall-health self-assessment test result: PASSED. However, with import, the TXG of all disks was consistent. However, after using the import command, the shell did not respond, the hard disk lights blinked simultaneously, and the system rebooted after eight hours. Then, the situation remained the same.

I tried upgrading to versions 24.04.2.5 and 24.10.2.3, as well as doing a clean install of 24.10.2.3, but I could not successfully import.

The commands tried were: zpool import, zpool import -F, zpool import -f, and zpool import -m -R /mnt/.

Any help is appreciated!

Jul 19 01:37:59 truenas kernel: task:zpool           state:D stack:0     pid:15759 ppid:1      flags:0x00004006
Jul 19 01:37:59 truenas kernel: Call Trace:
Jul 19 01:37:59 truenas kernel:  <TASK>
Jul 19 01:37:59 truenas kernel:  __schedule+0x349/0x950
Jul 19 01:37:59 truenas kernel:  schedule+0x5b/0xa0
Jul 19 01:37:59 truenas kernel:  io_schedule+0x46/0x70
Jul 19 01:37:59 truenas kernel:  cv_wait_common+0xaa/0x130 [spl]
Jul 19 01:37:59 truenas kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Jul 19 01:37:59 truenas kernel:  txg_wait_synced_impl+0xc0/0x110 [zfs]
Jul 19 01:37:59 truenas kernel:  txg_wait_synced+0x10/0x40 [zfs]
Jul 19 01:37:59 truenas kernel:  spa_load_impl.constprop.0+0x3ff/0x5b0 [zfs]
Jul 19 01:37:59 truenas kernel:  spa_load+0x73/0x120 [zfs]
Jul 19 01:37:59 truenas kernel:  spa_load_best+0x54/0x250 [zfs]
Jul 19 01:37:59 truenas kernel:  spa_import+0x231/0x690 [zfs]
Jul 19 01:37:59 truenas kernel:  zfs_ioc_pool_import+0x15b/0x180 [zfs]
Jul 19 01:37:59 truenas kernel:  zfsdev_ioctl_common+0x680/0x790 [zfs]
Jul 19 01:37:59 truenas kernel:  ? __kmalloc_node+0xc6/0x150
Jul 19 01:37:59 truenas kernel:  zfsdev_ioctl+0x53/0xe0 [zfs]
Jul 19 01:37:59 truenas kernel:  __x64_sys_ioctl+0x97/0xd0
Jul 19 01:37:59 truenas kernel:  do_syscall_64+0x59/0xb0
Jul 19 01:37:59 truenas kernel:  ? __handle_mm_fault+0xbf1/0xd90
Jul 19 01:37:59 truenas kernel:  ? __count_memcg_events+0x4d/0x90
Jul 19 01:37:59 truenas kernel:  ? count_memcg_events.constprop.0+0x1a/0x30
Jul 19 01:37:59 truenas kernel:  ? handle_mm_fault+0xa2/0x370
Jul 19 01:37:59 truenas kernel:  ? do_user_addr_fault+0x323/0x630
Jul 19 01:37:59 truenas kernel:  ? exc_page_fault+0x77/0x170
Jul 19 01:37:59 truenas kernel:  entry_SYSCALL_64_after_hwframe+0x78/0xe2
Jul 19 01:37:59 truenas kernel: RIP: 0033:0x7f5e05661c5b
Jul 19 01:37:59 truenas kernel: RSP: 002b:00007ffd41702710 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Jul 19 01:37:59 truenas kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f5e05661c5b
Jul 19 01:37:59 truenas kernel: RDX: 00007ffd417027d0 RSI: 0000000000005a02 RDI: 0000000000000003
Jul 19 01:37:59 truenas kernel: RBP: 00007ffd41706ec0 R08: 00007f5e05737450 R09: 00007f5e05737450
Jul 19 01:37:59 truenas kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055b4f6ddc2c0
Jul 19 01:37:59 truenas kernel: R13: 00007ffd417027d0 R14: 000055b4f6f01440 R15: 000055b4f6de2530



root@truenas[~]# zpool import    
  pool: sok1001
    id: 1221631789954295656
 state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
        the '-f' flag.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-EY
config:

        sok1001                                   ONLINE
          raidz2-0                                ONLINE
            05802c1a-a4d3-4120-9f49-3c18de9340e6  ONLINE
            ee782483-dfd4-49f1-a537-845bdcd3deab  ONLINE
            66b0bdd6-58b1-4959-ae1a-ba84f87d5e70  ONLINE
            1cc4581f-326e-4645-b0ab-f6b3ba059dcb  ONLINE
            20db8e19-f082-4140-af01-acb3932aa38d  ONLINE
            a41d1487-ea1e-4b5e-8d3f-e2667151e464  ONLINE


root@truenas[~]# lsblk -o name,size,type,partuuid
NAME          SIZE TYPE PARTUUID
sda          14.6T disk 
|-sda1          2G part 5604ac97-46a8-4cd5-9c1b-61c7c8cfa5a7
`-sda2       14.6T part 20db8e19-f082-4140-af01-acb3932aa38d
sdb          14.6T disk 
|-sdb1          2G part cb1e004c-d88f-48b3-a347-bf40fc31b247
`-sdb2       14.6T part 1cc4581f-326e-4645-b0ab-f6b3ba059dcb
sdc          14.6T disk 
|-sdc1          2G part a1353500-426b-4b92-9b1c-19687f5e0305
`-sdc2       14.6T part a41d1487-ea1e-4b5e-8d3f-e2667151e464
sdd          14.6T disk 
|-sdd1          2G part bc2217de-aa44-4a72-996c-79bb23f1b1aa
`-sdd2       14.6T part 05802c1a-a4d3-4120-9f49-3c18de9340e6
sde          14.6T disk 
|-sde1          2G part b8e830be-941a-4490-be09-c3f131e9d898
`-sde2       14.6T part ee782483-dfd4-49f1-a537-845bdcd3deab
sdf          14.6T disk 
|-sdf1          2G part c53e889a-d952-4553-97f9-5cef3fc879f0
`-sdf2       14.6T part 66b0bdd6-58b1-4959-ae1a-ba84f87d5e70
sdg            50G disk 
|-sdg1          1M part 135ad031-da88-4a58-bc5f-5dd3fbf8e852
|-sdg2        512M part 7e26ce8c-7740-4d44-98a1-32b692044b0f
`-sdg3       49.5G part 4c49893c-9ca7-4de9-be39-817af3d4e9cc
sdh          14.6G disk 
sr0           9.5G rom  
zd0            60G disk 
zd16          120G disk 
zd32           60G disk 
nvme0n1     953.9G disk 
|-nvme0n1p1     2G part f5922c23-3574-4dfb-89ac-a164eb956c81
`-nvme0n1p2 951.9G part e3a88fea-cb0d-40f1-94de-4b4c5dc36166




root@truenas[~]# zdb -l /dev/sda2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 4278422679801059362
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 

root@truenas[~]# zdb -l /dev/sdb2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 10339353618853963483
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 

root@truenas[~]# zdb -l /dev/sdc2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 15237958642688602726
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 

root@truenas[~]# zdb -l /dev/sdd2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 705601381597961486
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 

root@truenas[~]# zdb -l /dev/sde2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 15682408288857988643
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 

root@truenas[~]# zdb -l /dev/sdf2
------------------------------------
LABEL 0 
------------------------------------
    version: 5000
    name: 'sok1001'
    state: 0
    txg: 6814766
    pool_guid: 1221631789954295656
    errata: 0
    hostid: 1981761578
    hostname: 'truenas'
    top_guid: 1132576499012000637
    guid: 16097378473779213230
    vdev_children: 1
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 1132576499012000637
        nparity: 2
        metaslab_array: 256
        metaslab_shift: 34
        ashift: 12
        asize: 95992471879680
        is_log: 0
        create_txg: 4
        children[0]:
            type: 'disk'
            id: 0
            guid: 705601381597961486
            path: '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6'
            whole_disk: 0
            DTL: 37037
            create_txg: 4
        children[1]:
            type: 'disk'
            id: 1
            guid: 15682408288857988643
            path: '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab'
            whole_disk: 0
            DTL: 37036
            create_txg: 4
        children[2]:
            type: 'disk'
            id: 2
            guid: 16097378473779213230
            path: '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70'
            whole_disk: 0
            DTL: 37035
            create_txg: 4
        children[3]:
            type: 'disk'
            id: 3
            guid: 10339353618853963483
            path: '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb'
            whole_disk: 0
            DTL: 37034
            create_txg: 4
        children[4]:
            type: 'disk'
            id: 4
            guid: 4278422679801059362
            path: '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d'
            whole_disk: 0
            DTL: 37033
            create_txg: 4
        children[5]:
            type: 'disk'
            id: 5
            guid: 15237958642688602726
            path: '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464'
            whole_disk: 0
            DTL: 37032
            create_txg: 4
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2
    labels = 0 1 2 3 
1 Like
root@truenas[~]# smartctl -x /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    2BHV1A6N
LU WWN Device Id: 5 000cca 295d9ee24
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:01:54 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1682) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   136   136   054    -    96
  3 Spin_Up_Time            POS---   083   083   001    -    354 (Average 353)
  4 Start_Stop_Count        -O--C-   100   100   000    -    73
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    32458
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   099   099   000    -    73
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   100   100   000    -    1556
193 Load_Cycle_Count        -O--C-   100   100   000    -    1556
194 Temperature_Celsius     -O----   055   055   000    -    39 (Min/Max 18/60)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32443         -
# 2  Short offline       Completed without error       00%     32433         -
# 3  Short offline       Completed without error       00%     32422         -
# 4  Short offline       Completed without error       00%     32418         -
# 5  Short offline       Completed without error       00%     32417         -
# 6  Short offline       Completed without error       00%     32416         -
# 7  Short offline       Aborted by host               10%     32407         -
# 8  Short offline       Interrupted (host reset)      10%     32403         -
# 9  Short offline       Completed without error       00%     32401         -
#10  Short offline       Completed without error       00%     32392         -
#11  Short offline       Aborted by host               10%     32384         -
#12  Short offline       Completed without error       00%     32377         -
#13  Short offline       Completed without error       00%     32368         -
#14  Short offline       Completed without error       00%     32359         -
#15  Short offline       Completed without error       00%     32350         -
#16  Short offline       Completed without error       00%     32341         -
#17  Short offline       Completed without error       00%     32332         -
#18  Short offline       Completed without error       00%     32323         -
#19  Short offline       Completed without error       00%     32314         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    39 Celsius
Power Cycle Min/Max Temperature:     29/39 Celsius
Lifetime    Min/Max Temperature:     18/60 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (59)

Index    Estimated Time   Temperature Celsius
  60    2025-07-20 11:54    45  **************************
  61    2025-07-20 11:55    45  **************************
  62    2025-07-20 11:56    44  *************************
  63    2025-07-20 11:57    44  *************************
  64    2025-07-20 11:58    44  *************************
  65    2025-07-20 11:59    43  ************************
  66    2025-07-20 12:00    43  ************************
  67    2025-07-20 12:01    43  ************************
  68    2025-07-20 12:02    42  ***********************
 ...    ..(  2 skipped).    ..  ***********************
  71    2025-07-20 12:05    42  ***********************
  72    2025-07-20 12:06    41  **********************
 ...    ..(  3 skipped).    ..  **********************
  76    2025-07-20 12:10    41  **********************
  77    2025-07-20 12:11    40  *********************
 ...    ..(  4 skipped).    ..  *********************
  82    2025-07-20 12:16    40  *********************
  83    2025-07-20 12:17    39  ********************
 ...    ..( 27 skipped).    ..  ********************
 111    2025-07-20 12:45    39  ********************
 112    2025-07-20 12:46    38  *******************
 ...    ..(  3 skipped).    ..  *******************
 116    2025-07-20 12:50    38  *******************
 117    2025-07-20 12:51    39  ********************
 118    2025-07-20 12:52    39  ********************
 119    2025-07-20 12:53    38  *******************
 ...    ..(  8 skipped).    ..  *******************
   0    2025-07-20 13:02    38  *******************
   1    2025-07-20 13:03    39  ********************
   2    2025-07-20 13:04    38  *******************
 ...    ..(  4 skipped).    ..  *******************
   7    2025-07-20 13:09    38  *******************
   8    2025-07-20 13:10    39  ********************
   9    2025-07-20 13:11    23  ****
  10    2025-07-20 13:12    24  *****
  11    2025-07-20 13:13    24  *****
  12    2025-07-20 13:14    25  ******
  13    2025-07-20 13:15    25  ******
  14    2025-07-20 13:16    26  *******
  15    2025-07-20 13:17    26  *******
  16    2025-07-20 13:18    27  ********
  17    2025-07-20 13:19    27  ********
  18    2025-07-20 13:20    28  *********
  19    2025-07-20 13:21    28  *********
  20    2025-07-20 13:22    29  **********
  21    2025-07-20 13:23    29  **********
  22    2025-07-20 13:24    29  **********
  23    2025-07-20 13:25    30  ***********
  24    2025-07-20 13:26    30  ***********
  25    2025-07-20 13:27    31  ************
  26    2025-07-20 13:28    31  ************
  27    2025-07-20 13:29    31  ************
  28    2025-07-20 13:30    32  *************
  29    2025-07-20 13:31    32  *************
  30    2025-07-20 13:32    32  *************
  31    2025-07-20 13:33    33  **************
  32    2025-07-20 13:34    33  **************
  33    2025-07-20 13:35    33  **************
  34    2025-07-20 13:36    34  ***************
 ...    ..(  2 skipped).    ..  ***************
  37    2025-07-20 13:39    34  ***************
  38    2025-07-20 13:40    35  ****************
  39    2025-07-20 13:41    35  ****************
  40    2025-07-20 13:42    35  ****************
  41    2025-07-20 13:43    36  *****************
 ...    ..(  2 skipped).    ..  *****************
  44    2025-07-20 13:46    36  *****************
  45    2025-07-20 13:47    37  ******************
 ...    ..(  3 skipped).    ..  ******************
  49    2025-07-20 13:51    37  ******************
  50    2025-07-20 13:52    38  *******************
 ...    ..(  2 skipped).    ..  *******************
  53    2025-07-20 13:55    38  *******************
  54    2025-07-20 13:56    39  ********************
 ...    ..(  3 skipped).    ..  ********************
  58    2025-07-20 14:00    39  ********************
  59    2025-07-20 14:01    46  ***************************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              73  ---  Lifetime Power-On Resets
0x01  0x010  4           32458  ---  Power-on Hours
0x01  0x018  6    284733812880  ---  Logical Sectors Written
0x01  0x020  6       982302226  ---  Number of Write Commands
0x01  0x028  6   1527777932415  ---  Logical Sectors Read
0x01  0x030  6      3372907569  ---  Number of Read Commands
0x01  0x038  6    116850194450  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           32163  ---  Spindle Motor Power-on Hours
0x03  0x010  4           32162  ---  Head Flying Hours
0x03  0x018  4            1556  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              39  ---  Current Temperature
0x05  0x010  1              53  N--  Average Short Term Temperature
0x05  0x018  1              41  N--  Average Long Term Temperature
0x05  0x020  1              60  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              58  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              41  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             182  ---  Number of Hardware Resets
0x06  0x010  4              49  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS


root@truenas[~]# smartctl -x /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    2CHTG47P
LU WWN Device Id: 5 000cca 2a1d9357a
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:02:33 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1908) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   136   136   054    -    96
  3 Spin_Up_Time            POS---   084   084   001    -    357 (Average 295)
  4 Start_Stop_Count        -O--C-   100   100   000    -    74
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    32485
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   099   099   000    -    69
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   100   100   000    -    3115
193 Load_Cycle_Count        -O--C-   100   100   000    -    3115
194 Temperature_Celsius     -O----   053   053   000    -    40 (Min/Max 18/63)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32472         -
# 2  Short offline       Completed without error       00%     32461         -
# 3  Short offline       Aborted by host               10%     32452         -
# 4  Short offline       Completed without error       00%     32448         -
# 5  Short offline       Completed without error       00%     32447         -
# 6  Short offline       Completed without error       00%     32445         -
# 7  Short offline       Aborted by host               10%     32437         -
# 8  Short offline       Interrupted (host reset)      10%     32433         -
# 9  Short offline       Completed without error       00%     32431         -
#10  Short offline       Completed without error       00%     32422         -
#11  Short offline       Aborted by host               10%     32414         -
#12  Short offline       Completed without error       00%     32406         -
#13  Short offline       Completed without error       00%     32397         -
#14  Short offline       Completed without error       00%     32388         -
#15  Short offline       Completed without error       00%     32379         -
#16  Short offline       Completed without error       00%     32370         -
#17  Short offline       Completed without error       00%     32361         -
#18  Short offline       Completed without error       00%     32352         -
#19  Short offline       Completed without error       00%     32343         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    40 Celsius
Power Cycle Min/Max Temperature:     29/40 Celsius
Lifetime    Min/Max Temperature:     18/63 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (99)

Index    Estimated Time   Temperature Celsius
 100    2025-07-20 11:55    60  ***************************************+
 101    2025-07-20 11:56    60  ***************************************+
 102    2025-07-20 11:57    60  ***************************************+
 103    2025-07-20 11:58    61  ***************************************+
 ...    ..( 49 skipped).    ..  ***************************************+
  25    2025-07-20 12:48    61  ***************************************+
  26    2025-07-20 12:49    60  ***************************************+
  27    2025-07-20 12:50    60  ***************************************+
  28    2025-07-20 12:51    61  ***************************************+
  29    2025-07-20 12:52    61  ***************************************+
  30    2025-07-20 12:53    61  ***************************************+
  31    2025-07-20 12:54    60  ***************************************+
  32    2025-07-20 12:55    60  ***************************************+
  33    2025-07-20 12:56    61  ***************************************+
 ...    ..(  3 skipped).    ..  ***************************************+
  37    2025-07-20 13:00    61  ***************************************+
  38    2025-07-20 13:01    60  ***************************************+
  39    2025-07-20 13:02    61  ***************************************+
 ...    ..(  7 skipped).    ..  ***************************************+
  47    2025-07-20 13:10    61  ***************************************+
  48    2025-07-20 13:11    60  ***************************************+
  49    2025-07-20 13:12    23  ****
  50    2025-07-20 13:13    24  *****
  51    2025-07-20 13:14    24  *****
  52    2025-07-20 13:15    25  ******
  53    2025-07-20 13:16    26  *******
  54    2025-07-20 13:17    26  *******
  55    2025-07-20 13:18    27  ********
  56    2025-07-20 13:19    27  ********
  57    2025-07-20 13:20    28  *********
  58    2025-07-20 13:21    28  *********
  59    2025-07-20 13:22    28  *********
  60    2025-07-20 13:23    29  **********
  61    2025-07-20 13:24    29  **********
  62    2025-07-20 13:25    29  **********
  63    2025-07-20 13:26    30  ***********
  64    2025-07-20 13:27    30  ***********
  65    2025-07-20 13:28    31  ************
  66    2025-07-20 13:29    31  ************
  67    2025-07-20 13:30    32  *************
 ...    ..(  2 skipped).    ..  *************
  70    2025-07-20 13:33    32  *************
  71    2025-07-20 13:34    33  **************
  72    2025-07-20 13:35    33  **************
  73    2025-07-20 13:36    34  ***************
 ...    ..(  2 skipped).    ..  ***************
  76    2025-07-20 13:39    34  ***************
  77    2025-07-20 13:40    35  ****************
  78    2025-07-20 13:41    35  ****************
  79    2025-07-20 13:42    35  ****************
  80    2025-07-20 13:43    36  *****************
 ...    ..(  2 skipped).    ..  *****************
  83    2025-07-20 13:46    36  *****************
  84    2025-07-20 13:47    37  ******************
 ...    ..(  2 skipped).    ..  ******************
  87    2025-07-20 13:50    37  ******************
  88    2025-07-20 13:51    38  *******************
 ...    ..(  3 skipped).    ..  *******************
  92    2025-07-20 13:55    38  *******************
  93    2025-07-20 13:56    39  ********************
 ...    ..(  3 skipped).    ..  ********************
  97    2025-07-20 14:00    39  ********************
  98    2025-07-20 14:01    40  *********************
  99    2025-07-20 14:02    60  ***************************************+

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              69  ---  Lifetime Power-On Resets
0x01  0x010  4           32485  ---  Power-on Hours
0x01  0x018  6    201760957148  ---  Logical Sectors Written
0x01  0x020  6       897327719  ---  Number of Write Commands
0x01  0x028  6   1446922995357  ---  Logical Sectors Read
0x01  0x030  6      3024833631  ---  Number of Read Commands
0x01  0x038  6    116947096300  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           32320  ---  Spindle Motor Power-on Hours
0x03  0x010  4           32320  ---  Head Flying Hours
0x03  0x018  4            3115  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               3  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              40  ---  Current Temperature
0x05  0x010  1              54  N--  Average Short Term Temperature
0x05  0x018  1              42  N--  Average Long Term Temperature
0x05  0x020  1              63  ---  Highest Temperature
0x05  0x028  1              18  ---  Lowest Temperature
0x05  0x030  1              61  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              44  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4            1881  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             190  ---  Number of Hardware Resets
0x06  0x010  4              49  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS


root@truenas[~]# smartctl -x /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    3GKVSEAK
LU WWN Device Id: 5 000cca 2aff6701d
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:03:00 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1699) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    100
  3 Spin_Up_Time            POS---   084   084   001    -    322 (Average 339)
  4 Start_Stop_Count        -O--C-   100   100   000    -    55
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   128   128   020    -    18
  9 Power_On_Hours          -O--C-   096   096   000    -    29637
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    55
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   099   099   000    -    11152
193 Load_Cycle_Count        -O--C-   099   099   000    -    11152
194 Temperature_Celsius     -O----   057   057   000    -    37 (Min/Max 0/52)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29622         -
# 2  Short offline       Completed without error       00%     29611         -
# 3  Short offline       Completed without error       00%     29601         -
# 4  Short offline       Completed without error       00%     29597         -
# 5  Short offline       Completed without error       00%     29596         -
# 6  Short offline       Completed without error       00%     29594         -
# 7  Short offline       Aborted by host               10%     29586         -
# 8  Short offline       Interrupted (host reset)      10%     29582         -
# 9  Short offline       Completed without error       00%     29580         -
#10  Short offline       Completed without error       00%     29571         -
#11  Short offline       Aborted by host               10%     29563         -
#12  Short offline       Completed without error       00%     29555         -
#13  Short offline       Completed without error       00%     29546         -
#14  Short offline       Completed without error       00%     29537         -
#15  Short offline       Completed without error       00%     29528         -
#16  Short offline       Completed without error       00%     29519         -
#17  Short offline       Completed without error       00%     29510         -
#18  Short offline       Completed without error       00%     29501         -
#19  Short offline       Completed without error       00%     29492         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    37 Celsius
Power Cycle Min/Max Temperature:     29/37 Celsius
Lifetime    Min/Max Temperature:      0/52 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (36)

Index    Estimated Time   Temperature Celsius
  37    2025-07-20 11:56    46  ***************************
  38    2025-07-20 11:57    46  ***************************
  39    2025-07-20 11:58    45  **************************
 ...    ..(  3 skipped).    ..  **************************
  43    2025-07-20 12:02    45  **************************
  44    2025-07-20 12:03    44  *************************
 ...    ..(  3 skipped).    ..  *************************
  48    2025-07-20 12:07    44  *************************
  49    2025-07-20 12:08    43  ************************
 ...    ..(  4 skipped).    ..  ************************
  54    2025-07-20 12:13    43  ************************
  55    2025-07-20 12:14    42  ***********************
 ...    ..( 12 skipped).    ..  ***********************
  68    2025-07-20 12:27    42  ***********************
  69    2025-07-20 12:28    41  **********************
  70    2025-07-20 12:29    42  ***********************
  71    2025-07-20 12:30    41  **********************
 ...    ..( 40 skipped).    ..  **********************
 112    2025-07-20 13:11    41  **********************
 113    2025-07-20 13:12    23  ****
 114    2025-07-20 13:13    24  *****
 115    2025-07-20 13:14    24  *****
 116    2025-07-20 13:15    25  ******
 117    2025-07-20 13:16    25  ******
 118    2025-07-20 13:17    26  *******
 119    2025-07-20 13:18    26  *******
 120    2025-07-20 13:19    27  ********
 121    2025-07-20 13:20    27  ********
 122    2025-07-20 13:21    27  ********
 123    2025-07-20 13:22    28  *********
 124    2025-07-20 13:23    29  **********
 125    2025-07-20 13:24    29  **********
 126    2025-07-20 13:25    29  **********
 127    2025-07-20 13:26    30  ***********
   0    2025-07-20 13:27    29  **********
   1    2025-07-20 13:28    30  ***********
   2    2025-07-20 13:29    30  ***********
   3    2025-07-20 13:30    31  ************
   4    2025-07-20 13:31    31  ************
   5    2025-07-20 13:32    31  ************
   6    2025-07-20 13:33    32  *************
 ...    ..(  3 skipped).    ..  *************
  10    2025-07-20 13:37    32  *************
  11    2025-07-20 13:38    33  **************
  12    2025-07-20 13:39    33  **************
  13    2025-07-20 13:40    33  **************
  14    2025-07-20 13:41    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  18    2025-07-20 13:45    34  ***************
  19    2025-07-20 13:46    35  ****************
 ...    ..(  3 skipped).    ..  ****************
  23    2025-07-20 13:50    35  ****************
  24    2025-07-20 13:51    36  *****************
 ...    ..(  5 skipped).    ..  *****************
  30    2025-07-20 13:57    36  *****************
  31    2025-07-20 13:58    37  ******************
 ...    ..(  3 skipped).    ..  ******************
  35    2025-07-20 14:02    37  ******************
  36    2025-07-20 14:03    46  ***************************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              55  ---  Lifetime Power-On Resets
0x01  0x010  4           29637  ---  Power-on Hours
0x01  0x018  6     77209186667  ---  Logical Sectors Written
0x01  0x020  6       660081622  ---  Number of Write Commands
0x01  0x028  6    249247845561  ---  Logical Sectors Read
0x01  0x030  6       651059685  ---  Number of Read Commands
0x01  0x038  6    106693345150  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           12984  ---  Spindle Motor Power-on Hours
0x03  0x010  4           12984  ---  Head Flying Hours
0x03  0x018  4           11152  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4             153  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              37  ---  Current Temperature
0x05  0x010  1              47  N--  Average Short Term Temperature
0x05  0x018  1              38  N--  Average Long Term Temperature
0x05  0x020  1              52  ---  Highest Temperature
0x05  0x028  1               0  ---  Lowest Temperature
0x05  0x030  1              50  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              38  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             175  ---  Number of Hardware Resets
0x06  0x010  4              42  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS
root@truenas[~]# smartctl -x /dev/sdd
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    2CKNBYXN
LU WWN Device Id: 5 000cca 2a1f38ad9
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:05:37 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1897) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   136   136   054    -    96
  3 Spin_Up_Time            POS---   088   088   001    -    243 (Average 266)
  4 Start_Stop_Count        -O--C-   100   100   000    -    59
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    29633
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    46
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   099   099   000    -    11161
193 Load_Cycle_Count        -O--C-   099   099   000    -    11161
194 Temperature_Celsius     -O----   056   056   000    -    38 (Min/Max 17/53)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29618         -
# 2  Short offline       Completed without error       00%     29608         -
# 3  Short offline       Completed without error       00%     29595         -
# 4  Short offline       Completed without error       00%     29594         -
# 5  Short offline       Completed without error       00%     29593         -
# 6  Short offline       Aborted by host               10%     29584         -
# 7  Short offline       Interrupted (host reset)      10%     29580         -
# 8  Short offline       Completed without error       00%     29578         -
# 9  Short offline       Completed without error       00%     29569         -
#10  Short offline       Aborted by host               10%     29561         -
#11  Short offline       Completed without error       00%     29554         -
#12  Short offline       Completed without error       00%     29545         -
#13  Short offline       Completed without error       00%     29536         -
#14  Short offline       Completed without error       00%     29527         -
#15  Short offline       Completed without error       00%     29518         -
#16  Short offline       Completed without error       00%     29509         -
#17  Short offline       Completed without error       00%     29500         -
#18  Short offline       Completed without error       00%     29491         -
#19  Short offline       Completed without error       00%     29482         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    38 Celsius
Power Cycle Min/Max Temperature:     29/38 Celsius
Lifetime    Min/Max Temperature:     17/53 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (34)

Index    Estimated Time   Temperature Celsius
  35    2025-07-20 11:58    45  **************************
  36    2025-07-20 11:59    44  *************************
 ...    ..(  3 skipped).    ..  *************************
  40    2025-07-20 12:03    44  *************************
  41    2025-07-20 12:04    43  ************************
 ...    ..(  3 skipped).    ..  ************************
  45    2025-07-20 12:08    43  ************************
  46    2025-07-20 12:09    42  ***********************
 ...    ..(  7 skipped).    ..  ***********************
  54    2025-07-20 12:17    42  ***********************
  55    2025-07-20 12:18    41  **********************
 ...    ..( 25 skipped).    ..  **********************
  81    2025-07-20 12:44    41  **********************
  82    2025-07-20 12:45    40  *********************
  83    2025-07-20 12:46    40  *********************
  84    2025-07-20 12:47    41  **********************
  85    2025-07-20 12:48    41  **********************
  86    2025-07-20 12:49    40  *********************
 ...    ..( 21 skipped).    ..  *********************
 108    2025-07-20 13:11    40  *********************
 109    2025-07-20 13:12    24  *****
 110    2025-07-20 13:13    25  ******
 111    2025-07-20 13:14    25  ******
 112    2025-07-20 13:15    25  ******
 113    2025-07-20 13:16    26  *******
 114    2025-07-20 13:17    26  *******
 115    2025-07-20 13:18    27  ********
 116    2025-07-20 13:19    27  ********
 117    2025-07-20 13:20    28  *********
 118    2025-07-20 13:21    28  *********
 119    2025-07-20 13:22    28  *********
 120    2025-07-20 13:23    29  **********
 121    2025-07-20 13:24    29  **********
 122    2025-07-20 13:25    29  **********
 123    2025-07-20 13:26    30  ***********
 124    2025-07-20 13:27    30  ***********
 125    2025-07-20 13:28    30  ***********
 126    2025-07-20 13:29    31  ************
 127    2025-07-20 13:30    31  ************
   0    2025-07-20 13:31    32  *************
 ...    ..(  3 skipped).    ..  *************
   4    2025-07-20 13:35    32  *************
   5    2025-07-20 13:36    33  **************
 ...    ..(  2 skipped).    ..  **************
   8    2025-07-20 13:39    33  **************
   9    2025-07-20 13:40    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  13    2025-07-20 13:44    34  ***************
  14    2025-07-20 13:45    35  ****************
 ...    ..(  2 skipped).    ..  ****************
  17    2025-07-20 13:48    35  ****************
  18    2025-07-20 13:49    36  *****************
 ...    ..(  5 skipped).    ..  *****************
  24    2025-07-20 13:55    36  *****************
  25    2025-07-20 13:56    37  ******************
  26    2025-07-20 13:57    36  *****************
  27    2025-07-20 13:58    37  ******************
 ...    ..(  5 skipped).    ..  ******************
  33    2025-07-20 14:04    37  ******************
  34    2025-07-20 14:05    45  **************************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              46  ---  Lifetime Power-On Resets
0x01  0x010  4           29633  ---  Power-on Hours
0x01  0x018  6     75655827525  ---  Logical Sectors Written
0x01  0x020  6       631939287  ---  Number of Write Commands
0x01  0x028  6    248342025908  ---  Logical Sectors Read
0x01  0x030  6       644428661  ---  Number of Read Commands
0x01  0x038  6    106681099550  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           13076  ---  Spindle Motor Power-on Hours
0x03  0x010  4           13076  ---  Head Flying Hours
0x03  0x018  4           11161  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              38  ---  Current Temperature
0x05  0x010  1              47  N--  Average Short Term Temperature
0x05  0x018  1              39  N--  Average Long Term Temperature
0x05  0x020  1              53  ---  Highest Temperature
0x05  0x028  1              17  ---  Lowest Temperature
0x05  0x030  1              50  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              39  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             160  ---  Number of Hardware Resets
0x06  0x010  4              44  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS


root@truenas[~]# smartctl -x /dev/sde
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    2BJ8LP5N
LU WWN Device Id: 5 000cca 295e0181c
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:06:24 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1807) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    100
  3 Spin_Up_Time            POS---   087   087   001    -    304 (Average 222)
  4 Start_Stop_Count        -O--C-   100   100   000    -    59
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    29633
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    47
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   099   099   000    -    11222
193 Load_Cycle_Count        -O--C-   099   099   000    -    11222
194 Temperature_Celsius     -O----   053   053   000    -    40 (Min/Max 16/60)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29618         -
# 2  Short offline       Completed without error       00%     29608         -
# 3  Short offline       Completed without error       00%     29595         -
# 4  Short offline       Completed without error       00%     29594         -
# 5  Short offline       Completed without error       00%     29592         -
# 6  Short offline       Aborted by host               10%     29584         -
# 7  Short offline       Interrupted (host reset)      10%     29580         -
# 8  Short offline       Completed without error       00%     29578         -
# 9  Short offline       Completed without error       00%     29569         -
#10  Short offline       Aborted by host               10%     29561         -
#11  Short offline       Completed without error       00%     29553         -
#12  Short offline       Completed without error       00%     29544         -
#13  Short offline       Completed without error       00%     29535         -
#14  Short offline       Completed without error       00%     29526         -
#15  Short offline       Completed without error       00%     29517         -
#16  Short offline       Completed without error       00%     29508         -
#17  Short offline       Completed without error       00%     29499         -
#18  Short offline       Completed without error       00%     29490         -
#19  Short offline       Completed without error       00%     29481         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    40 Celsius
Power Cycle Min/Max Temperature:     30/40 Celsius
Lifetime    Min/Max Temperature:     16/60 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (122)

Index    Estimated Time   Temperature Celsius
 123    2025-07-20 11:59    45  **************************
 124    2025-07-20 12:00    44  *************************
 125    2025-07-20 12:01    44  *************************
 126    2025-07-20 12:02    44  *************************
 127    2025-07-20 12:03    43  ************************
   0    2025-07-20 12:04    43  ************************
   1    2025-07-20 12:05    43  ************************
   2    2025-07-20 12:06    42  ***********************
 ...    ..(  2 skipped).    ..  ***********************
   5    2025-07-20 12:09    42  ***********************
   6    2025-07-20 12:10    41  **********************
 ...    ..(  3 skipped).    ..  **********************
  10    2025-07-20 12:14    41  **********************
  11    2025-07-20 12:15    40  *********************
 ...    ..( 10 skipped).    ..  *********************
  22    2025-07-20 12:26    40  *********************
  23    2025-07-20 12:27    39  ********************
 ...    ..( 21 skipped).    ..  ********************
  45    2025-07-20 12:49    39  ********************
  46    2025-07-20 12:50    38  *******************
 ...    ..(  3 skipped).    ..  *******************
  50    2025-07-20 12:54    38  *******************
  51    2025-07-20 12:55    39  ********************
  52    2025-07-20 12:56    38  *******************
 ...    ..( 14 skipped).    ..  *******************
  67    2025-07-20 13:11    38  *******************
  68    2025-07-20 13:12    24  *****
  69    2025-07-20 13:13    25  ******
  70    2025-07-20 13:14    25  ******
  71    2025-07-20 13:15    25  ******
  72    2025-07-20 13:16    26  *******
  73    2025-07-20 13:17    27  ********
  74    2025-07-20 13:18    27  ********
  75    2025-07-20 13:19    28  *********
  76    2025-07-20 13:20    28  *********
  77    2025-07-20 13:21    28  *********
  78    2025-07-20 13:22    29  **********
  79    2025-07-20 13:23    30  ***********
  80    2025-07-20 13:24    30  ***********
  81    2025-07-20 13:25    30  ***********
  82    2025-07-20 13:26    31  ************
  83    2025-07-20 13:27    31  ************
  84    2025-07-20 13:28    31  ************
  85    2025-07-20 13:29    32  *************
 ...    ..(  2 skipped).    ..  *************
  88    2025-07-20 13:32    32  *************
  89    2025-07-20 13:33    33  **************
  90    2025-07-20 13:34    33  **************
  91    2025-07-20 13:35    33  **************
  92    2025-07-20 13:36    34  ***************
  93    2025-07-20 13:37    34  ***************
  94    2025-07-20 13:38    34  ***************
  95    2025-07-20 13:39    35  ****************
  96    2025-07-20 13:40    35  ****************
  97    2025-07-20 13:41    35  ****************
  98    2025-07-20 13:42    36  *****************
 ...    ..(  2 skipped).    ..  *****************
 101    2025-07-20 13:45    36  *****************
 102    2025-07-20 13:46    37  ******************
 ...    ..(  2 skipped).    ..  ******************
 105    2025-07-20 13:49    37  ******************
 106    2025-07-20 13:50    38  *******************
 ...    ..(  3 skipped).    ..  *******************
 110    2025-07-20 13:54    38  *******************
 111    2025-07-20 13:55    39  ********************
 ...    ..(  4 skipped).    ..  ********************
 116    2025-07-20 14:00    39  ********************
 117    2025-07-20 14:01    40  *********************
 ...    ..(  3 skipped).    ..  *********************
 121    2025-07-20 14:05    40  *********************
 122    2025-07-20 14:06    45  **************************

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              47  ---  Lifetime Power-On Resets
0x01  0x010  4           29633  ---  Power-on Hours
0x01  0x018  6     73549335906  ---  Logical Sectors Written
0x01  0x020  6       603490350  ---  Number of Write Commands
0x01  0x028  6    247574604723  ---  Logical Sectors Read
0x01  0x030  6       633818452  ---  Number of Read Commands
0x01  0x038  6    106680065900  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           13119  ---  Spindle Motor Power-on Hours
0x03  0x010  4           13118  ---  Head Flying Hours
0x03  0x018  4           11222  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              40  ---  Current Temperature
0x05  0x010  1              53  N--  Average Short Term Temperature
0x05  0x018  1              41  N--  Average Long Term Temperature
0x05  0x020  1              60  ---  Highest Temperature
0x05  0x028  1              16  ---  Lowest Temperature
0x05  0x030  1              58  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              41  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             160  ---  Number of Hardware Resets
0x06  0x010  4              47  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS


root@truenas[~]# smartctl -x /dev/sdf
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Ultrastar DC HC550
Device Model:     WDC  WUH721816ALE6L4
Serial Number:    2CJBHRJN
LU WWN Device Id: 5 000cca 2a1e16a20
Firmware Version: PCGNW232
User Capacity:    16,000,900,661,248 bytes [16.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database 7.3/5787
ATA Version is:   ACS-4 published, ANSI INCITS 529-2018
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jul 20 14:07:10 2025 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever 
                                        been run.
Total time to complete Offline 
data collection:                (  101) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (1703) minutes.
SCT capabilities:              (0x003d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     PO-R--   100   100   001    -    0
  2 Throughput_Performance  P-S---   135   135   054    -    100
  3 Spin_Up_Time            POS---   086   086   001    -    346 (Average 222)
  4 Start_Stop_Count        -O--C-   100   100   000    -    87
  5 Reallocated_Sector_Ct   PO--CK   100   100   001    -    0
  7 Seek_Error_Rate         PO-R--   100   100   001    -    0
  8 Seek_Time_Performance   P-S---   140   140   020    -    15
  9 Power_On_Hours          -O--C-   096   096   000    -    32234
 10 Spin_Retry_Count        PO--C-   100   100   001    -    0
 12 Power_Cycle_Count       -O--CK   099   099   000    -    75
 22 Helium_Level            PO---K   100   100   025    -    100
192 Power-Off_Retract_Count -O--CK   100   100   000    -    1436
193 Load_Cycle_Count        -O--C-   100   100   000    -    1436
194 Temperature_Celsius     -O----   052   052   000    -    41 (Min/Max 0/63)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_Sector  -O---K   100   100   000    -    0
198 Offline_Uncorrectable   ---R--   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O-R--   100   100   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL     R/O    256  Device Statistics log
0x04       SL      R/O    255  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x08       GPL     R/O      2  Power Conditions log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O  30001  Pending Defects log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x12       GPL     R/O      1  SATA NCQ Non-Data log
0x13       GPL     R/O      1  SATA NCQ Send and Receive log
0x15       GPL     R/W      1  Rebuild Assist log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x24       GPL     R/O    256  Current Device Internal Status Data log
0x25       GPL     R/O    256  Saved Device Internal Status Data log
0x2f       GPL     R/O      1  Set Sector Configuration
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32221         -
# 2  Short offline       Completed without error       00%     32211         -
# 3  Short offline       Aborted by host               10%     32202         -
# 4  Short offline       Completed without error       00%     32197         -
# 5  Short offline       Completed without error       00%     32197         -
# 6  Short offline       Completed without error       00%     32195         -
# 7  Short offline       Aborted by host               10%     32186         -
# 8  Short offline       Interrupted (host reset)      10%     32183         -
# 9  Short offline       Completed without error       00%     32181         -
#10  Short offline       Completed without error       00%     32172         -
#11  Short offline       Aborted by host               10%     32163         -
#12  Short offline       Completed without error       00%     32156         -
#13  Short offline       Completed without error       00%     32147         -
#14  Short offline       Completed without error       00%     32138         -
#15  Short offline       Completed without error       00%     32129         -
#16  Short offline       Completed without error       00%     32120         -
#17  Short offline       Completed without error       00%     32111         -
#18  Short offline       Completed without error       00%     32102         -
#19  Short offline       Completed without error       00%     32093         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       256 (0x0100)
Device State:                        Active (0)
Current Temperature:                    41 Celsius
Power Cycle Min/Max Temperature:     30/41 Celsius
Lifetime    Min/Max Temperature:      0/63 Celsius
Under/Over Temperature Limit Count:   0/0
SMART Status:                        0xc24f (PASSED)
Minimum supported ERC Time Limit:    65 (6.5 seconds)

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -40/70 Celsius
Temperature History Size (Index):    128 (45)

Index    Estimated Time   Temperature Celsius
  46    2025-07-20 12:00    61  ***************************************+
 ...    ..( 70 skipped).    ..  ***************************************+
 117    2025-07-20 13:11    61  ***************************************+
 118    2025-07-20 13:12    24  *****
 119    2025-07-20 13:13    25  ******
 120    2025-07-20 13:14    25  ******
 121    2025-07-20 13:15    25  ******
 122    2025-07-20 13:16    26  *******
 123    2025-07-20 13:17    27  ********
 124    2025-07-20 13:18    27  ********
 125    2025-07-20 13:19    28  *********
 126    2025-07-20 13:20    28  *********
 127    2025-07-20 13:21    28  *********
   0    2025-07-20 13:22    29  **********
   1    2025-07-20 13:23    30  ***********
   2    2025-07-20 13:24    30  ***********
   3    2025-07-20 13:25    30  ***********
   4    2025-07-20 13:26    31  ************
   5    2025-07-20 13:27    31  ************
   6    2025-07-20 13:28    31  ************
   7    2025-07-20 13:29    32  *************
   8    2025-07-20 13:30    32  *************
   9    2025-07-20 13:31    32  *************
  10    2025-07-20 13:32    33  **************
  11    2025-07-20 13:33    33  **************
  12    2025-07-20 13:34    33  **************
  13    2025-07-20 13:35    34  ***************
  14    2025-07-20 13:36    34  ***************
  15    2025-07-20 13:37    34  ***************
  16    2025-07-20 13:38    35  ****************
 ...    ..(  2 skipped).    ..  ****************
  19    2025-07-20 13:41    35  ****************
  20    2025-07-20 13:42    36  *****************
  21    2025-07-20 13:43    36  *****************
  22    2025-07-20 13:44    36  *****************
  23    2025-07-20 13:45    37  ******************
 ...    ..(  2 skipped).    ..  ******************
  26    2025-07-20 13:48    37  ******************
  27    2025-07-20 13:49    38  *******************
 ...    ..(  2 skipped).    ..  *******************
  30    2025-07-20 13:52    38  *******************
  31    2025-07-20 13:53    39  ********************
 ...    ..(  3 skipped).    ..  ********************
  35    2025-07-20 13:57    39  ********************
  36    2025-07-20 13:58    40  *********************
 ...    ..(  4 skipped).    ..  *********************
  41    2025-07-20 14:03    40  *********************
  42    2025-07-20 14:04    41  **********************
  43    2025-07-20 14:05    41  **********************
  44    2025-07-20 14:06    41  **********************
  45    2025-07-20 14:07    61  ***************************************+

SCT Error Recovery Control:
           Read: Disabled
          Write: Disabled

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              75  ---  Lifetime Power-On Resets
0x01  0x010  4           32234  ---  Power-on Hours
0x01  0x018  6    371785485938  ---  Logical Sectors Written
0x01  0x020  6      1057276032  ---  Number of Write Commands
0x01  0x028  6   1612173834398  ---  Logical Sectors Read
0x01  0x030  6      3637481559  ---  Number of Read Commands
0x01  0x038  6    116045981850  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4           32059  ---  Spindle Motor Power-on Hours
0x03  0x010  4           32059  ---  Head Flying Hours
0x03  0x018  4            1436  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              41  ---  Current Temperature
0x05  0x010  1              54  N--  Average Short Term Temperature
0x05  0x018  1              42  N--  Average Long Term Temperature
0x05  0x020  1              63  ---  Highest Temperature
0x05  0x028  1               0  ---  Lowest Temperature
0x05  0x030  1              61  N--  Highest Average Short Term Temperature
0x05  0x038  1              25  N--  Lowest Average Short Term Temperature
0x05  0x040  1              43  N--  Highest Average Long Term Temperature
0x05  0x048  1              25  N--  Lowest Average Long Term Temperature
0x05  0x050  4            2009  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             187  ---  Number of Hardware Resets
0x06  0x010  4              59  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
0xff  =====  =               =  ===  == Vendor Specific Statistics (rev 1) ==
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c)
No Defects Logged

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            2  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS
root@truenas[~]# smartctl -l error /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l error /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l error /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l error /dev/sdd
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l error /dev/sde
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l error /dev/sdf
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
No Errors Logged

root@truenas[~]# smartctl -l selftest /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32443         -
# 2  Short offline       Completed without error       00%     32433         -
# 3  Short offline       Completed without error       00%     32422         -
# 4  Short offline       Completed without error       00%     32418         -
# 5  Short offline       Completed without error       00%     32417         -
# 6  Short offline       Completed without error       00%     32416         -
# 7  Short offline       Aborted by host               10%     32407         -
# 8  Short offline       Interrupted (host reset)      10%     32403         -
# 9  Short offline       Completed without error       00%     32401         -
#10  Short offline       Completed without error       00%     32392         -
#11  Short offline       Aborted by host               10%     32384         -
#12  Short offline       Completed without error       00%     32377         -
#13  Short offline       Completed without error       00%     32368         -
#14  Short offline       Completed without error       00%     32359         -
#15  Short offline       Completed without error       00%     32350         -
#16  Short offline       Completed without error       00%     32341         -
#17  Short offline       Completed without error       00%     32332         -
#18  Short offline       Completed without error       00%     32323         -
#19  Short offline       Completed without error       00%     32314         -
#20  Short offline       Completed without error       00%     32305         -
#21  Short offline       Completed without error       00%     32296         -

root@truenas[~]# smartctl -l selftest /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32472         -
# 2  Short offline       Completed without error       00%     32461         -
# 3  Short offline       Aborted by host               10%     32452         -
# 4  Short offline       Completed without error       00%     32448         -
# 5  Short offline       Completed without error       00%     32447         -
# 6  Short offline       Completed without error       00%     32445         -
# 7  Short offline       Aborted by host               10%     32437         -
# 8  Short offline       Interrupted (host reset)      10%     32433         -
# 9  Short offline       Completed without error       00%     32431         -
#10  Short offline       Completed without error       00%     32422         -
#11  Short offline       Aborted by host               10%     32414         -
#12  Short offline       Completed without error       00%     32406         -
#13  Short offline       Completed without error       00%     32397         -
#14  Short offline       Completed without error       00%     32388         -
#15  Short offline       Completed without error       00%     32379         -
#16  Short offline       Completed without error       00%     32370         -
#17  Short offline       Completed without error       00%     32361         -
#18  Short offline       Completed without error       00%     32352         -
#19  Short offline       Completed without error       00%     32343         -
#20  Short offline       Completed without error       00%     32334         -
#21  Short offline       Completed without error       00%     32325         -

root@truenas[~]# smartctl -l selftest /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29622         -
# 2  Short offline       Completed without error       00%     29611         -
# 3  Short offline       Completed without error       00%     29601         -
# 4  Short offline       Completed without error       00%     29597         -
# 5  Short offline       Completed without error       00%     29596         -
# 6  Short offline       Completed without error       00%     29594         -
# 7  Short offline       Aborted by host               10%     29586         -
# 8  Short offline       Interrupted (host reset)      10%     29582         -
# 9  Short offline       Completed without error       00%     29580         -
#10  Short offline       Completed without error       00%     29571         -
#11  Short offline       Aborted by host               10%     29563         -
#12  Short offline       Completed without error       00%     29555         -
#13  Short offline       Completed without error       00%     29546         -
#14  Short offline       Completed without error       00%     29537         -
#15  Short offline       Completed without error       00%     29528         -
#16  Short offline       Completed without error       00%     29519         -
#17  Short offline       Completed without error       00%     29510         -
#18  Short offline       Completed without error       00%     29501         -
#19  Short offline       Completed without error       00%     29492         -
#20  Short offline       Completed without error       00%     29483         -
#21  Short offline       Completed without error       00%     29474         -

root@truenas[~]# smartctl -l selftest /dev/sdd
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29618         -
# 2  Short offline       Completed without error       00%     29608         -
# 3  Short offline       Completed without error       00%     29595         -
# 4  Short offline       Completed without error       00%     29594         -
# 5  Short offline       Completed without error       00%     29593         -
# 6  Short offline       Aborted by host               10%     29584         -
# 7  Short offline       Interrupted (host reset)      10%     29580         -
# 8  Short offline       Completed without error       00%     29578         -
# 9  Short offline       Completed without error       00%     29569         -
#10  Short offline       Aborted by host               10%     29561         -
#11  Short offline       Completed without error       00%     29554         -
#12  Short offline       Completed without error       00%     29545         -
#13  Short offline       Completed without error       00%     29536         -
#14  Short offline       Completed without error       00%     29527         -
#15  Short offline       Completed without error       00%     29518         -
#16  Short offline       Completed without error       00%     29509         -
#17  Short offline       Completed without error       00%     29500         -
#18  Short offline       Completed without error       00%     29491         -
#19  Short offline       Completed without error       00%     29482         -
#20  Short offline       Completed without error       00%     29473         -
#21  Short offline       Aborted by host               10%     29462         -

root@truenas[~]# smartctl -l selftest /dev/sde
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     29618         -
# 2  Short offline       Completed without error       00%     29608         -
# 3  Short offline       Completed without error       00%     29595         -
# 4  Short offline       Completed without error       00%     29594         -
# 5  Short offline       Completed without error       00%     29592         -
# 6  Short offline       Aborted by host               10%     29584         -
# 7  Short offline       Interrupted (host reset)      10%     29580         -
# 8  Short offline       Completed without error       00%     29578         -
# 9  Short offline       Completed without error       00%     29569         -
#10  Short offline       Aborted by host               10%     29561         -
#11  Short offline       Completed without error       00%     29553         -
#12  Short offline       Completed without error       00%     29544         -
#13  Short offline       Completed without error       00%     29535         -
#14  Short offline       Completed without error       00%     29526         -
#15  Short offline       Completed without error       00%     29517         -
#16  Short offline       Completed without error       00%     29508         -
#17  Short offline       Completed without error       00%     29499         -
#18  Short offline       Completed without error       00%     29490         -
#19  Short offline       Completed without error       00%     29481         -
#20  Short offline       Completed without error       00%     29472         -
#21  Short offline       Aborted by host               10%     29462         -

root@truenas[~]# smartctl -l selftest /dev/sdf
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.44-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     32221         -
# 2  Short offline       Completed without error       00%     32211         -
# 3  Short offline       Aborted by host               10%     32202         -
# 4  Short offline       Completed without error       00%     32197         -
# 5  Short offline       Completed without error       00%     32197         -
# 6  Short offline       Completed without error       00%     32195         -
# 7  Short offline       Aborted by host               10%     32186         -
# 8  Short offline       Interrupted (host reset)      10%     32183         -
# 9  Short offline       Completed without error       00%     32181         -
#10  Short offline       Completed without error       00%     32172         -
#11  Short offline       Aborted by host               10%     32163         -
#12  Short offline       Completed without error       00%     32156         -
#13  Short offline       Completed without error       00%     32147         -
#14  Short offline       Completed without error       00%     32138         -
#15  Short offline       Completed without error       00%     32129         -
#16  Short offline       Completed without error       00%     32120         -
#17  Short offline       Completed without error       00%     32111         -
#18  Short offline       Completed without error       00%     32102         -
#19  Short offline       Completed without error       00%     32093         -
#20  Short offline       Completed without error       00%     32084         -
#21  Short offline       Completed without error       00%     32075         -


Thanks for the translation!
So back out of “International” section.

Please be careful with commands you do not understand, especially if they could cause data loss.
-R /mnt is to reproduce the mount point used by the middleware.
-m ignores the SLOG… which you do not have.
So these options were not of much help.

Since -f and -F were not successful, I guess that the next step is to try (dry run):
zpool import -fFn sok1001
Please report any error message, or the lack of any message when the command returns. (The latter is acctually what we wish for.)
And then post (as formatted text, thanks for your good use of the </> button)
tail -n 200 /proc/spl/kstat/zfs/dbgmsg
which should indicate where any issue during import might be.

Thanks etorix

but this command

zfs import -fFn sok1001

not work

root@truenas[~]# zfs import -fFn sok1001
unrecognized command 'import'
usage: zfs command args ...
where 'command' is one of the following:

I run this link

zpool import -fFn sok1001
root@truenas[~]# tail -n 200 /proc/spl/kstat/zfs/dbgmsg
1752994679   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024602, spa local date, vdev_id 0, ms_id 95, weight 700000000000001, selected txg 7024484 (604206 ms ago), alloc_txg 0, loaded 752661 ms ago, max_size 536100864
1752994827   ffff92119fa3b280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 105, smp_length 121904, unflushed_allocs 495616, unflushed_frees 360448, freed 0, defer 0 + 0, unloaded time 148499 ms, loading_time 11 ms, ms_max_size 780910592, max size error 0, old_weight 740000000000002, new_weight 740000000000002
1752994827   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024631, spa local date, vdev_id 0, ms_id 92, weight 700000000000003, selected txg 7024484 (752726 ms ago), alloc_txg 0, loaded 901147 ms ago, max_size 403533824
1752994827   ffff9211a0860000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 95, smp_length 26272, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 3 ms, ms_max_size 536100864, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752994827   ffff92119fa3e500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 5 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752994827   ffff92119ab06500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 94, smp_length 68520, unflushed_allocs 151552, unflushed_frees 290816, freed 0, defer 0 + 12288, unloaded time 148519 ms, loading_time 8 ms, ms_max_size 539324416, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752994827   ffff9211a0af4bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 21 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1752994827   ffff9211a0219940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 38 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1752994827   ffff9211a16f8000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 39 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752994827   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 47 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752994827   ffff9211ebee0000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024631, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 148519 ms, loading_time 49 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875511 ms ago, max_size 530911232
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 97, weight 740000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875513 ms ago, max_size 1069182976
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 98, weight 740000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875520 ms ago, max_size 552349696
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 100, weight 740000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875554 ms ago, max_size 546504704
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 103, weight 740000000000004, selected txg 7024684 (604207 ms ago), alloc_txg 7024633, loaded 2770309 ms ago, max_size 774074368
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 91, weight 700000000000002, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875539 ms ago, max_size 419549184
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 94, weight 740000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 7024682, loaded 875552 ms ago, max_size 539324416
1752995703   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024802, spa local date, vdev_id 0, ms_id 95, weight 700000000000001, selected txg 7024684 (604207 ms ago), alloc_txg 0, loaded 875557 ms ago, max_size 536100864
1752995728   ffff9211a3430000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 103, smp_length 334672, unflushed_allocs 0, unflushed_frees 53248, freed 0, defer 0 + 0, unloaded time 25608 ms, loading_time 34 ms, ms_max_size 774074368, max size error 0, old_weight 740000000000004, new_weight 740000000000004
1752995729   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024807, spa local date, vdev_id 0, ms_id 92, weight 700000000000003, selected txg 7024684 (629864 ms ago), alloc_txg 0, loaded 901179 ms ago, max_size 403533824
1752995729   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7024807, spa local date, vdev_id 0, ms_id 93, weight 700000000000001, selected txg 7024684 (629864 ms ago), alloc_txg 0, loaded 1802383 ms ago, max_size 387538944
1752995729   ffff92119fa39940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 95, smp_length 26272, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25656 ms, loading_time 2 ms, ms_max_size 536100864, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752995729   ffff9211a0af4bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 94, smp_length 68808, unflushed_allocs 147456, unflushed_frees 229376, freed 0, defer 0 + 86016, unloaded time 25656 ms, loading_time 4 ms, ms_max_size 539324416, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752995729   ffff92119ab06500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25656 ms, loading_time 10 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752995729   ffff92119fa38000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 93, smp_length 161760, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 12 ms, ms_max_size 387538944, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752995729   ffff9211a16fe500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25656 ms, loading_time 18 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1752995729   ffff921190e10000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 28 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1752995729   ffff92119ab00000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25657 ms, loading_time 30 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752995729   ffff9211ba314bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25656 ms, loading_time 36 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752995729   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7024807, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 25656 ms, loading_time 46 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752997478   ffff9211d3ed0000 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1752997478   ffff9211d3ed0000 spa.c:6916:spa_tryimport(): spa_tryimport: importing sok1001
1752997478   ffff9211d3ed0000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9211d3ed0000-sok1001, config trusted): LOADING
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1752997478   ffff9211d3ed0000 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': best uberblock found for spa $import-ffff9211d3ed0000-sok1001. txg 6823467
1752997478   ffff9211d3ed0000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9211d3ed0000-sok1001, config untrusted): using uberblock with txg=6823467
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1752997478   ffff92119cac4bc0 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1752997478   ffff9211d3ed0000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1752997478   ffff9211d3ed0000 spa.c:9209:spa_async_request(): spa=$import-ffff9211d3ed0000-sok1001 async request task=2048
1752997478   ffff9211d3ed0000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9211d3ed0000-sok1001, config trusted): LOADED
1752997478   ffff9211d3ed0000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9211d3ed0000-sok1001, config trusted): UNLOADING
1752997739   ffff921190c9e500 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1752997739   ffff921190c9e500 spa.c:6916:spa_tryimport(): spa_tryimport: importing sok1001
1752997739   ffff921190c9e500 spa_misc.c:429:spa_load_note(): spa_load($import-ffff921190c9e500-sok1001, config trusted): LOADING
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1752997739   ffff921190c9e500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': best uberblock found for spa $import-ffff921190c9e500-sok1001. txg 6823467
1752997739   ffff921190c9e500 spa_misc.c:429:spa_load_note(): spa_load($import-ffff921190c9e500-sok1001, config untrusted): using uberblock with txg=6823467
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1752997739   ffff9211d9dc3280 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1752997739   ffff921190c9e500 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1752997739   ffff921190c9e500 spa.c:9209:spa_async_request(): spa=$import-ffff921190c9e500-sok1001 async request task=2048
1752997739   ffff921190c9e500 spa_misc.c:429:spa_load_note(): spa_load($import-ffff921190c9e500-sok1001, config trusted): LOADED
1752997739   ffff921190c9e500 spa_misc.c:429:spa_load_note(): spa_load($import-ffff921190c9e500-sok1001, config trusted): UNLOADING
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416744 ms ago, max_size 530911232
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 97, weight 740000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416728 ms ago, max_size 1069182976
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 98, weight 740000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416738 ms ago, max_size 552349696
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 100, weight 740000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416764 ms ago, max_size 546504704
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 91, weight 700000000000002, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416756 ms ago, max_size 419549184
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 29, weight 780000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 7025159, loaded 5212796 ms ago, max_size 1084186624
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 93, weight 700000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416762 ms ago, max_size 387538944
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 94, weight 740000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 7025154, loaded 2416770 ms ago, max_size 539324416
1752998145   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025279, spa local date, vdev_id 0, ms_id 95, weight 700000000000001, selected txg 7025161 (604207 ms ago), alloc_txg 0, loaded 2416772 ms ago, max_size 536100864
1752998150   ffff92119cad1940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 29, smp_length 141520, unflushed_allocs 290816, unflushed_frees 266240, freed 0, defer 0 + 0, unloaded time 5131 ms, loading_time 16 ms, ms_max_size 1084186624, max size error 0, old_weight 780000000000001, new_weight 780000000000001
1752998150   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025280, spa local date, vdev_id 0, ms_id 92, weight 700000000000003, selected txg 7025161 (609366 ms ago), alloc_txg 0, loaded 2421905 ms ago, max_size 403533824
1752998150   ffff9211a0af4bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 95, smp_length 26272, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 3 ms, ms_max_size 536100864, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752998150   ffff921193ec3280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 94, smp_length 69024, unflushed_allocs 118784, unflushed_frees 233472, freed 0, defer 4096 + 0, unloaded time 5159 ms, loading_time 8 ms, ms_max_size 539324416, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff9211ba729940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 10 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff921198381940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 93, smp_length 161760, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 18 ms, ms_max_size 387538944, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752998150   ffff921198386500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 25 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff92119cad3280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 32 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1752998150   ffff92119ab00000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 43 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff9211a16fe500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 49 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752998150   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 50 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1752999174   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025480, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7025362 (604224 ms ago), alloc_txg 0, loaded 1024009 ms ago, max_size 530911232
1752999174   ffff9211a3434bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025480, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 26 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 972831 ms ago, max_size 530911232
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 97, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996892 ms ago, max_size 1069182976
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 98, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996873 ms ago, max_size 552349696
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 99, weight 780000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 7025350, loaded 7214858 ms ago, max_size 1103282176
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 100, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996906 ms ago, max_size 546504704
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 91, weight 700000000000002, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996885 ms ago, max_size 419549184
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 94, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 7025550, loaded 1996909 ms ago, max_size 539324416
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 95, weight 700000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996914 ms ago, max_size 536100864
1753000198   ffff9211b9389940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 99, smp_length 306016, unflushed_allocs 90112, unflushed_frees 229376, freed 0, defer 0 + 0, unloaded time 51215 ms, loading_time 32 ms, ms_max_size 1103282176, max size error 0, old_weight 780000000000001, new_weight 780000000000001
1753000198   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025680, spa local date, vdev_id 0, ms_id 92, weight 700000000000003, selected txg 7025552 (655466 ms ago), alloc_txg 0, loaded 2048125 ms ago, max_size 403533824
1753000198   ffff9211a16fcbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 95, smp_length 26272, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 3 ms, ms_max_size 536100864, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000198   ffff921198381940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 94, smp_length 69408, unflushed_allocs 0, unflushed_frees 77824, freed 0, defer 77824 + 0, unloaded time 51258 ms, loading_time 7 ms, ms_max_size 539324416, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff9211b8e5e500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 10 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff921198f5b280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 18 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1753000198   ffff9211a16de500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 23 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff92119d830000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 26 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000198   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 26 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff9211b9399940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 40 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1753006184   ffff9212007f8000 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1753006184   ffff9212007f8000 spa.c:6916:spa_tryimport(): spa_tryimport: importing sok1001
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): LOADING
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': best uberblock found for spa $import-ffff9212007f8000-sok1001. txg 6823467
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config untrusted): using uberblock with txg=6823467
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1753006184   ffff9212007f8000 spa.c:9209:spa_async_request(): spa=$import-ffff9212007f8000-sok1001 async request task=2048
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): LOADED
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): UNLOADING
1753006184   ffff9212007f8000 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1753006184   ffff9212007f8000 spa.c:6761:spa_import(): spa_import: importing sok1001
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config trusted): LOADING
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': best uberblock found for spa sok1001. txg 6823467
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config untrusted): using uberblock with txg=6823467
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=0
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1753006194   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config trusted): Read 698 log space maps (2350 total blocks - blksz = 131072 bytes) in 8835 ms
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1753006194   ffff9211b986b280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 0, spa sok1001, vdev_id 0, ms_id 4650, smp_length 2451488, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 13334953 ms, loading_time 284 ms, ms_max_size 16236728320, max size error 16236728320, old_weight 740000000000001, new_weight 840000000000001
1753006202   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data

No response after executing the command

Do I need to abort it?

Or do I wait?

They’re working non-stop again.

new log

1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Claiming ZIL blocks
1753006292   ffff9212007f8000 mmp.c:239:mmp_thread_start(): MMP thread started pool 'sok1001' gethrtime 13433203960558
1753006292   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Syncing ZIL claims
1 Like

My bad! It is indeed “zpool import …”

The log shows that ZFS tries various transaction groups which are WAY ahead of 6814766 in the labels. :scream:
You are in deep trouble, and I’m afraid this may need extreme measures, with the risk of data loss. I’d prefer if @HoneyBadger could take over at this point and advise on the possible use of the ‘X’ flag.

Do you have a backup?
Do you have free storage to use for emergency backups if the pool can be mounted read only?

new log

1753011982   ffff921c99790000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 12189, spa boot-pool, vdev_id 0, ms_id 46, smp_length 4192, unflushed_allocs 0, unflushed_frees 4096, freed 0, defer 0 + 4096, unloaded time 19123073 ms, loading_time 0 ms, ms_max_size 535568384, max size error 535523328, old_weight 740000000000001, new_weight 740000000000001
1753012581   ffff921c9a170000 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 12306, spa boot-pool, vdev_id 0, ms_id 67, weight 740000000000001, selected txg 12188 (603928 ms ago), alloc_txg 0, loaded 19696069 ms ago, max_size 536870912

It would be great if it could let me read the data. Of course, the more data I can recover, the better. But I need time to buy some hard drives. There are no large capacity hard drives for sale in my area, so I can only buy them online and wait for a while.

Do I need to wait for it to finish running?

-n makes it a dry run anyway so nothing bad should happen from letting it run as long as it takes to run down possible txgs.
The next step would be attempt a read-only mount with extreme recovery, but let’s not rush: You need to have free storage to salvage the data, and I’d prefer that dangerous commands are first validated by an expert.

Today I use finalshell to connect NAS. Noticed something:

I guess the memory may out in 4 hours.

Not sure if this is the reason the system rebooted about eight hours after running “zpool import”.

root@truenas[~]# tail -n 200 /var/log/middlewared.log  
[2025/07/20 01:36:04] (INFO) InterfaceService.configure():20 - Configuring interface 'bond1'
[2025/07/20 01:36:04] (INFO) InterfaceService.configure():20 - Configuring interface 'enp9s0'
[2025/07/20 01:36:04] (DEBUG) InterfaceService.run_dhcp():1843 - Starting dhclient for bond1
[2025/07/20 01:36:04] (DEBUG) InterfaceService.run_dhcp():1843 - Starting dhclient for enp9s0
[2025/07/20 01:37:05] (INFO) InterfaceService.sync():1753 - Interfaces in database: bond1, enp9s0
[2025/07/20 01:37:05] (INFO) InterfaceService.unconfigure():138 - Unconfiguring interface 'enp7s0'
[2025/07/20 01:37:05] (INFO) InterfaceService.unconfigure():138 - Unconfiguring interface 'enp8s0'
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task alert.flush_alerts to run every 3600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task alert.process_alerts to run every 60 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task auditbackend._AuditBackendService__lifecycle_cleanup to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task auth.twofactor.remove_expired_secrets to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task certificate.renew_certs to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task certificateauthority.crl_generation to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task docker.state.periodic_check to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task kerberos.keytab.check_updated_keytab to run every 3600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task kmip.sync_keys to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task mail.send_mail_queue to run every 600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task pool.dataset.sync_db_keys to run every 86400 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task rate.limit.cache_clear to run every 600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task reporting.netdataweb_expire to run every 600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task service.check_deprecated_services to run every 3600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task smb.sharesec.check_share_info_tdb to run every 3600 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task truecommand.health_check to run every 1800 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task vmware.delete_pending_snapshots to run every 10800.0 seconds
[2025/07/20 01:37:10] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task zettarepl.flush_state to run every 3600 seconds
[2025/07/20 02:09:02] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 02:22:47] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 02:33:47] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 02:57:47] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 03:08:19] (INFO) middlewared.terminate():2125 - Terminating
[2025/07/20 13:28:22] (INFO) middlewared.__init__():934 - Starting TrueNAS-SCALE-24.10.2.3 middleware
[2025/07/20 13:28:43] (DEBUG) middlewared.setup():41 - Setting timezone to 'Asia/Phnom_Penh'
[2025/07/20 13:28:43] (WARNING) middlewared.i18n.set_language():20 - Failed to set language 'zh-hans': FileNotFoundError(2, 'No such file or directory')
[2025/07/20 13:28:48] (DEBUG) middlewared.generate_keys():199 - Generating SSH host keys
[2025/07/20 13:28:48] (DEBUG) middlewared.setup():25 - Certificate setup for System complete
[2025/07/20 13:28:49] (INFO) RDMAService._get_link_choices():67 - Fetching RDMA link netdev choices
[2025/07/20 13:28:49] (DEBUG) middlewared.__plugins_setup():1105 - All plugins loaded
[2025/07/20 13:28:49] (DEBUG) middlewared.__initialize():2114 - Accepting connections
[2025/07/20 13:28:50] (INFO) DiskService.log_disk_info():76 - Found disks: {'sdh': {'serial': '6143731237148600743', 'lunid': None}, 'sdg': {'serial': '000000000000000021', 'lunid': None}, 'nvme0n1': {'serial': '22103000000000009245', 'lunid': 'nvme.1e4b-3232313033303030303030303030303039323435-6169676f204e564d65205353442050373030305a20315442-00000001'}, 'sdc': {'serial': '3GKVSEAK', 'lunid': '5000cca2aff6701d'}, 'sda': {'serial': '2BHV1A6N', 'lunid': '5000cca295d9ee24'}, 'sdb': {'serial': '2CHTG47P', 'lunid': '5000cca2a1d9357a'}, 'sdf': {'serial': '2CJBHRJN', 'lunid': '5000cca2a1e16a20'}, 'sde': {'serial': '2BJ8LP5N', 'lunid': '5000cca295e0181c'}, 'sdd': {'serial': '2CKNBYXN', 'lunid': '5000cca2a1f38ad9'}}
[2025/07/20 13:28:51] (DEBUG) PoolService.import_on_boot():464 - Creating '/data/zfs' (if it doesnt already exist)
[2025/07/20 13:28:51] (DEBUG) PoolService.import_on_boot():471 - Creating '/data/zfs/zpool.cache' (if it doesnt already exist)
[2025/07/20 13:28:51] (DEBUG) PoolService.import_on_boot_impl():309 - Importing 'local date' with guid: '13277177274598996053'
[2025/07/20 13:28:52] (DEBUG) PoolService.import_on_boot_impl():321 - Done importing 'local date' with guid '13277177274598996053'
[2025/07/20 13:28:52] (DEBUG) PoolService.normalize_root_dataset_properties():259 - Calling zfs.dataset.query on 'local date' with guid '13277177274598996053'
[2025/07/20 13:28:52] (DEBUG) PoolService.normalize_root_dataset_properties():269 - Done calling zfs.dataset.query on 'local date' with guid '13277177274598996053'
[2025/07/20 13:28:52] (DEBUG) PoolService.encryption_is_active():237 - Checking if root dataset is encrypted: 'local date'
[2025/07/20 13:28:52] (DEBUG) PoolService.recursive_mount():211 - Going to mount root dataset recusively: 'local date'
[2025/07/20 13:28:54] (DEBUG) PoolService.unlock_on_boot_impl():372 - SUCCESS unlocking encrypted dataset(s) (if any) for 'local date'
[2025/07/20 13:28:54] (DEBUG) PoolService.import_on_boot():499 - Calling pool.post_import
[2025/07/20 13:28:55] (WARNING) SystemDatasetService.sysdataset_path():112 - /var/db/system: mountpoint not found
[2025/07/20 13:28:56] (DEBUG) smartd.ensure_smart_enabled():28 - SMART is not supported on ['/dev/sdh', '-d', 'sat']
[2025/07/20 13:28:56] (DEBUG) smartd.ensure_smart_enabled():28 - SMART is not supported on ['/dev/sdg', '-d', 'sat']
[2025/07/20 13:28:57] (INFO) SystemDatasetService.__post_mount_actions():599 - Successfully ran post mount action 'nfs.setup_directories' endpoint for 'local date/.system/nfs' dataset
[2025/07/20 13:28:57] (INFO) SystemDatasetService.__post_mount_actions():599 - Successfully ran post mount action 'reporting.post_dataset_mount_action' endpoint for 'local date/.system/netdata-ae32c386e13840b2bf9c0083275e7941' dataset
[2025/07/20 13:28:58] (DEBUG) middlewared.render_body():34 - UPSMON: monpwd field empty, upsmon will fail to start.
[2025/07/20 13:29:02] (DEBUG) PoolService.import_on_boot():501 - Finished calling pool.post_import
[2025/07/20 13:29:06] (INFO) InterfaceService.lag_setup():14 - Setting up bond1
[2025/07/20 13:29:12] (INFO) InterfaceService.lag_setup():67 - Changing protocol on 'bond1' to LACP
[2025/07/20 13:29:17] (INFO) InterfaceService.lag_setup():71 - Changing xmit_hash_policy on 'bond1' to layer2+3
[2025/07/20 13:29:17] (INFO) InterfaceService.lag_setup():75 - Changing lacpdu_rate on 'bond1' to slow
[2025/07/20 13:29:18] (INFO) InterfaceService.configure():20 - Configuring interface 'bond1'
[2025/07/20 13:29:18] (INFO) InterfaceService.configure():20 - Configuring interface 'enp9s0'
[2025/07/20 13:29:19] (DEBUG) InterfaceService.run_dhcp():1843 - Starting dhclient for bond1
[2025/07/20 13:29:19] (DEBUG) InterfaceService.run_dhcp():1843 - Starting dhclient for enp9s0
[2025/07/20 13:30:20] (INFO) InterfaceService.sync():1753 - Interfaces in database: bond1, enp9s0
[2025/07/20 13:30:20] (INFO) InterfaceService.unconfigure():138 - Unconfiguring interface 'enp7s0'
[2025/07/20 13:30:20] (INFO) InterfaceService.unconfigure():138 - Unconfiguring interface 'enp8s0'
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task alert.flush_alerts to run every 3600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task alert.process_alerts to run every 60 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task auditbackend._AuditBackendService__lifecycle_cleanup to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task auth.twofactor.remove_expired_secrets to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task certificate.renew_certs to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task certificateauthority.crl_generation to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task docker.state.periodic_check to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task kerberos.keytab.check_updated_keytab to run every 3600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task kmip.sync_keys to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task mail.send_mail_queue to run every 600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task pool.dataset.sync_db_keys to run every 86400 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task rate.limit.cache_clear to run every 600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task reporting.netdataweb_expire to run every 600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task service.check_deprecated_services to run every 3600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task smb.sharesec.check_share_info_tdb to run every 3600 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task truecommand.health_check to run every 1800 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task vmware.delete_pending_snapshots to run every 10800.0 seconds
[2025/07/20 13:30:25] (DEBUG) middlewared._setup_periodic_tasks():1118 - Setting up periodic task zettarepl.flush_state to run every 3600 seconds
[2025/07/20 14:19:12] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 17:18:02] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport
[2025/07/20 17:28:15] (ERROR) middlewared.reader():711 - Error in ShellWorkerThread.reader
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 709, in reader
    ).result()
      ^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/aiohttp/web_ws.py", line 315, in send_bytes
    await self._writer.send(data, binary=True, compress=compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 688, in send
    await self._send_frame(message, WSMsgType.BINARY, compress)
  File "/usr/lib/python3/dist-packages/aiohttp/http_websocket.py", line 601, in _send_frame
    raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport

new log

1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2660, smp_length 41280, unflushed_allocs 2153103360, unflushed_frees 442368, freed 0, defer 0 + 0, unloaded time 43408883 ms, loading_time 32 ms, ms_max_size 771137536, max size error 771100672, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3287, smp_length 149240, unflushed_allocs 104779776, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43408915 ms, loading_time 61 ms, ms_max_size 696844288, max size error 696844288, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2570, smp_length 295088, unflushed_allocs 369057792, unflushed_frees 147456, freed 0, defer 0 + 0, unloaded time 43408977 ms, loading_time 94 ms, ms_max_size 452542464, max size error 452395008, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2594, smp_length 1432, unflushed_allocs 948154368, unflushed_frees 1000980480, freed 0, defer 0 + 0, unloaded time 43409071 ms, loading_time 46 ms, ms_max_size 385769472, max size error 384417792, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2635, smp_length 216216, unflushed_allocs 2454712320, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43409119 ms, loading_time 63 ms, ms_max_size 491069440, max size error 491069440, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3127, smp_length 9288, unflushed_allocs 2342596608, unflushed_frees 494702592, freed 0, defer 0 + 0, unloaded time 43409182 ms, loading_time 75 ms, ms_max_size 201265152, max size error 201142272, old_weight 6c0000000000001, new_weight 6c0000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3253, smp_length 5920, unflushed_allocs 668098560, unflushed_frees 360062976, freed 0, defer 0 + 0, unloaded time 43409258 ms, loading_time 32 ms, ms_max_size 70078464, max size error 69009408, old_weight 680000000000001, new_weight 680000000000001

:open_mouth:
It has rewounded over 200,000 txg (almost 12 days!) and is getting close to txg 6814766 in the labels. By all means let it go there and see what happens.
But I really hope we’ll get insights from a ZFS expert here. How can be labels be so far away from what’s in the pool?

Was this unexpected reboot(s) due to power problems? Do you have the server set to power back on after an unexpected power down or is it set to stay turned off?

update log

1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2660, smp_length 41280, unflushed_allocs 2153103360, unflushed_frees 442368, freed 0, defer 0 + 0, unloaded time 43408883 ms, loading_time 32 ms, ms_max_size 771137536, max size error 771100672, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3287, smp_length 149240, unflushed_allocs 104779776, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43408915 ms, loading_time 61 ms, ms_max_size 696844288, max size error 696844288, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2570, smp_length 295088, unflushed_allocs 369057792, unflushed_frees 147456, freed 0, defer 0 + 0, unloaded time 43408977 ms, loading_time 94 ms, ms_max_size 452542464, max size error 452395008, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2594, smp_length 1432, unflushed_allocs 948154368, unflushed_frees 1000980480, freed 0, defer 0 + 0, unloaded time 43409071 ms, loading_time 46 ms, ms_max_size 385769472, max size error 384417792, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2635, smp_length 216216, unflushed_allocs 2454712320, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43409119 ms, loading_time 63 ms, ms_max_size 491069440, max size error 491069440, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3127, smp_length 9288, unflushed_allocs 2342596608, unflushed_frees 494702592, freed 0, defer 0 + 0, unloaded time 43409182 ms, loading_time 75 ms, ms_max_size 201265152, max size error 201142272, old_weight 6c0000000000001, new_weight 6c0000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3253, smp_length 5920, unflushed_allocs 668098560, unflushed_frees 360062976, freed 0, defer 0 + 0, unloaded time 43409258 ms, loading_time 32 ms, ms_max_size 70078464, max size error 69009408, old_weight 680000000000001, new_weight 680000000000001
root@truenas[~]# tail -n 200 /proc/spl/kstat/zfs/dbgmsg
1752998150   ffff9211ba729940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 10 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff921198381940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 93, smp_length 161760, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 18 ms, ms_max_size 387538944, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752998150   ffff921198386500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 25 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff92119cad3280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 32 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1752998150   ffff92119ab00000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 43 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1752998150   ffff9211a16fe500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 5159 ms, loading_time 49 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1752998150   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025280, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 50 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1752999174   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025480, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7025362 (604224 ms ago), alloc_txg 0, loaded 1024009 ms ago, max_size 530911232
1752999174   ffff9211a3434bc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025480, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 26 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 96, weight 700000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 972831 ms ago, max_size 530911232
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 97, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996892 ms ago, max_size 1069182976
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 98, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996873 ms ago, max_size 552349696
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 99, weight 780000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 7025350, loaded 7214858 ms ago, max_size 1103282176
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 100, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996906 ms ago, max_size 546504704
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 91, weight 700000000000002, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996885 ms ago, max_size 419549184
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 94, weight 740000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 7025550, loaded 1996909 ms ago, max_size 539324416
1753000147   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025670, spa local date, vdev_id 0, ms_id 95, weight 700000000000001, selected txg 7025552 (604207 ms ago), alloc_txg 0, loaded 1996914 ms ago, max_size 536100864
1753000198   ffff9211b9389940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 99, smp_length 306016, unflushed_allocs 90112, unflushed_frees 229376, freed 0, defer 0 + 0, unloaded time 51215 ms, loading_time 32 ms, ms_max_size 1103282176, max size error 0, old_weight 780000000000001, new_weight 780000000000001
1753000198   ffff9211a09fe500 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 7025680, spa local date, vdev_id 0, ms_id 92, weight 700000000000003, selected txg 7025552 (655466 ms ago), alloc_txg 0, loaded 2048125 ms ago, max_size 403533824
1753000198   ffff9211a16fcbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 95, smp_length 26272, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 3 ms, ms_max_size 536100864, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000198   ffff921198381940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 94, smp_length 69408, unflushed_allocs 0, unflushed_frees 77824, freed 0, defer 77824 + 0, unloaded time 51258 ms, loading_time 7 ms, ms_max_size 539324416, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff9211b8e5e500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 100, smp_length 93088, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 10 ms, ms_max_size 546504704, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff921198f5b280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 91, smp_length 163952, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 18 ms, ms_max_size 419549184, max size error 0, old_weight 700000000000002, new_weight 700000000000002
1753000198   ffff9211a16de500 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 97, smp_length 441048, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 23 ms, ms_max_size 1069182976, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff92119d830000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 96, smp_length 464880, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 26 ms, ms_max_size 530911232, max size error 0, old_weight 700000000000001, new_weight 700000000000001
1753000198   ffff9211a16f9940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 98, smp_length 431384, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 51259 ms, loading_time 26 ms, ms_max_size 552349696, max size error 0, old_weight 740000000000001, new_weight 740000000000001
1753000198   ffff9211b9399940 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 7025680, spa local date, vdev_id 0, ms_id 92, smp_length 369912, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 0 ms, loading_time 40 ms, ms_max_size 403533824, max size error 0, old_weight 700000000000003, new_weight 700000000000003
1753006184   ffff9212007f8000 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1753006184   ffff9212007f8000 spa.c:6916:spa_tryimport(): spa_tryimport: importing sok1001
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): LOADING
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': best uberblock found for spa $import-ffff9212007f8000-sok1001. txg 6823467
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config untrusted): using uberblock with txg=6823467
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff9211a0876500 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1753006184   ffff9212007f8000 spa.c:9209:spa_async_request(): spa=$import-ffff9212007f8000-sok1001 async request task=2048
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): LOADED
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff9212007f8000-sok1001, config trusted): UNLOADING
1753006184   ffff9212007f8000 metaslab.c:1683:spa_set_allocator(): spa allocator: dynamic
1753006184   ffff9212007f8000 spa.c:6761:spa_import(): spa_import: importing sok1001
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config trusted): LOADING
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=1
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=1
1753006184   ffff9212007f8000 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': best uberblock found for spa sok1001. txg 6823467
1753006184   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config untrusted): using uberblock with txg=6823467
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d': probe done, cant_read=0 cant_write=0
1753006184   ffff92119e479940 vdev.c:167:vdev_dbgmsg(): disk vdev '/dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464': probe done, cant_read=0 cant_write=0
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading checkpoint txg
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading indirect vdev metadata
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Checking feature flags
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading special MOS directories
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading properties
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading AUX vdevs
1753006184   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading vdev metadata
1753006194   ffff9212007f8000 spa_misc.c:429:spa_load_note(): spa_load(sok1001, config trusted): Read 698 log space maps (2350 total blocks - blksz = 131072 bytes) in 8835 ms
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading dedup tables
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Loading BRT
1753006194   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying Log Devices
1753006194   ffff9211b986b280 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 0, spa sok1001, vdev_id 0, ms_id 4650, smp_length 2451488, unflushed_allocs 0, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 13334953 ms, loading_time 284 ms, ms_max_size 16236728320, max size error 16236728320, old_weight 740000000000001, new_weight 840000000000001
1753006202   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Verifying pool data
1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Calculating deflated space
1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Starting import
1753006280   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Claiming ZIL blocks
1753006292   ffff9212007f8000 mmp.c:239:mmp_thread_start(): MMP thread started pool 'sok1001' gethrtime 13433203960558
1753006292   ffff9212007f8000 spa_misc.c:2381:spa_import_progress_set_notes_impl(): 'sok1001' Syncing ZIL claims
1753011982   ffff921c99790000 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 12189, spa boot-pool, vdev_id 0, ms_id 46, smp_length 4192, unflushed_allocs 0, unflushed_frees 4096, freed 0, defer 0 + 4096, unloaded time 19123073 ms, loading_time 0 ms, ms_max_size 535568384, max size error 535523328, old_weight 740000000000001, new_weight 740000000000001
1753012581   ffff921c9a170000 metaslab.c:2604:metaslab_unload(): metaslab_unload: txg 12306, spa boot-pool, vdev_id 0, ms_id 67, weight 740000000000001, selected txg 12188 (603928 ms ago), alloc_txg 0, loaded 19696069 ms ago, max_size 536870912
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2660, smp_length 41280, unflushed_allocs 2153103360, unflushed_frees 442368, freed 0, defer 0 + 0, unloaded time 43408883 ms, loading_time 32 ms, ms_max_size 771137536, max size error 771100672, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3287, smp_length 149240, unflushed_allocs 104779776, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43408915 ms, loading_time 61 ms, ms_max_size 696844288, max size error 696844288, old_weight 740000000000001, new_weight 740000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2570, smp_length 295088, unflushed_allocs 369057792, unflushed_frees 147456, freed 0, defer 0 + 0, unloaded time 43408977 ms, loading_time 94 ms, ms_max_size 452542464, max size error 452395008, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2594, smp_length 1432, unflushed_allocs 948154368, unflushed_frees 1000980480, freed 0, defer 0 + 0, unloaded time 43409071 ms, loading_time 46 ms, ms_max_size 385769472, max size error 384417792, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 2635, smp_length 216216, unflushed_allocs 2454712320, unflushed_frees 0, freed 0, defer 0 + 0, unloaded time 43409119 ms, loading_time 63 ms, ms_max_size 491069440, max size error 491069440, old_weight 700000000000001, new_weight 700000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3127, smp_length 9288, unflushed_allocs 2342596608, unflushed_frees 494702592, freed 0, defer 0 + 0, unloaded time 43409182 ms, loading_time 75 ms, ms_max_size 201265152, max size error 201142272, old_weight 6c0000000000001, new_weight 6c0000000000001
1753036266   ffff921294e5cbc0 metaslab.c:2491:metaslab_load_impl(): metaslab_load: txg 6823468, spa sok1001, vdev_id 0, ms_id 3253, smp_length 5920, unflushed_allocs 668098560, unflushed_frees 360062976, freed 0, defer 0 + 0, unloaded time 43409258 ms, loading_time 32 ms, ms_max_size 70078464, max size error 69009408, old_weight 680000000000001, new_weight 680000000000001
1753036873   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 607 seconds ago, calls 1
1753036873   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753036873   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753036873   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753036873   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753036934   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 668 seconds ago, calls 2
1753036934   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753036995   ffff9211a3339940 spa_misc.c:668:spa_deadman(): slow spa_sync: started 729 seconds ago, calls 3
1753036995   ffff9211a3339940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753036995   ffff9211a3339940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753036995   ffff9211a3339940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753036995   ffff9211a3339940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037057   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 791 seconds ago, calls 4
1753037057   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037057   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037118   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 852 seconds ago, calls 5
1753037118   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037118   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037118   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037118   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037180   ffff921198f5b280 spa_misc.c:668:spa_deadman(): slow spa_sync: started 914 seconds ago, calls 6
1753037180   ffff921198f5b280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037180   ffff921198f5b280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037241   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 975 seconds ago, calls 7
1753037241   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037241   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037241   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037241   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037303   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1037 seconds ago, calls 8
1753037303   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037303   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037303   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037303   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037364   ffff921d8fe5b280 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1098 seconds ago, calls 9
1753037364   ffff921d8fe5b280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037425   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1160 seconds ago, calls 10
1753037425   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037425   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037425   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037425   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037487   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1221 seconds ago, calls 11
1753037487   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037487   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037487   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037548   ffff921198381940 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1282 seconds ago, calls 12
1753037548   ffff921198381940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037548   ffff921198381940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037610   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1344 seconds ago, calls 13
1753037610   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037610   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037610   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037610   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037671   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1405 seconds ago, calls 14
1753037671   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037671   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037733   ffff921b999bb280 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1467 seconds ago, calls 15
1753037794   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1528 seconds ago, calls 16
1753037794   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037794   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037794   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037794   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037856   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1590 seconds ago, calls 17
1753037856   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037856   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753037856   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037856   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037917   ffff9211d1e00000 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1651 seconds ago, calls 18
1753037917   ffff9211d1e00000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037917   ffff9211d1e00000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037917   ffff9211d1e00000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753037917   ffff9211d1e00000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753037978   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1713 seconds ago, calls 19
1753037978   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753037978   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753037978   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753037978   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038040   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1774 seconds ago, calls 20
1753038040   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038040   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038040   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038040   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038101   ffff921c9a09e500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1835 seconds ago, calls 21
1753038101   ffff921c9a09e500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038101   ffff921c9a09e500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038101   ffff921c9a09e500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038101   ffff921c9a09e500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038163   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1897 seconds ago, calls 22
1753038163   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038163   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038163   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038163   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038224   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 1958 seconds ago, calls 23
1753038224   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038224   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038224   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038224   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038286   ffff921191b33280 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2020 seconds ago, calls 24
1753038286   ffff921191b33280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038286   ffff921191b33280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038286   ffff921191b33280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038286   ffff921191b33280 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038347   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2081 seconds ago, calls 25
1753038347   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038409   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2143 seconds ago, calls 26
1753038409   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038409   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038470   ffff9211d12bcbc0 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2204 seconds ago, calls 27
1753038470   ffff9211d12bcbc0 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038470   ffff9211d12bcbc0 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038470   ffff9211d12bcbc0 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038470   ffff9211d12bcbc0 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038531   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2266 seconds ago, calls 28
1753038531   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038531   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038531   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038531   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038593   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2327 seconds ago, calls 29
1753038593   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038593   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038593   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038654   ffff9211b9381940 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2388 seconds ago, calls 30
1753038654   ffff9211b9381940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038716   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2450 seconds ago, calls 31
1753038716   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753038716   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038716   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038716   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038777   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2511 seconds ago, calls 32
1753038777   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038777   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038839   ffff92121b950000 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2573 seconds ago, calls 33
1753038839   ffff92121b950000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753038839   ffff92121b950000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038839   ffff92121b950000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038839   ffff92121b950000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038900   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2634 seconds ago, calls 34
1753038900   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038900   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753038900   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753038900   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753038961   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2696 seconds ago, calls 35
1753038961   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753038961   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753039023   ffff9211a3431940 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2757 seconds ago, calls 36
1753039023   ffff9211a3431940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753039023   ffff9211a3431940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039023   ffff9211a3431940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753039023   ffff9211a3431940 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753039084   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2819 seconds ago, calls 37
1753039084   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753039084   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039084   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753039084   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/20db8e19-f082-4140-af01-acb3932aa38d has 1 active IOs
1753039146   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2880 seconds ago, calls 38
1753039146   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs
1753039207   ffff921191290000 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2941 seconds ago, calls 39
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753039269   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 3003 seconds ago, calls 40
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs

To: etorix
Will it break due to low memory?
The newer the data, the less important it is.

To: SmallBarky
There was no unexpected restart. When I was organizing the files in the NAS on the Windows side, the progress of moving data became slower and slower, and finally got stuck.

Is smb a dangerous way to operate?

How full were your pools? You are supposed to keep them below 80%, 50% if they are used for block type storage.

truenas automatically rebooted
Is it possible to increase the memory to make it complete?
dbgmsg only records information after startup?

A little more than 80%

Possibly. But we may enter at a specific txg if we can find a suitable one.
There’s already a lot of information from this attempt.
I recommend waiting for expert advice for fear of causing more damage to the pool.

SMB itself is not dangerous, TrueNAS just integrates many software together. The danger is that NFS, HostPath and other methods are operating files at the same time during the process of SMB reading and writing files. These reading and writing methods have conflicts in the operation of files and may cause file corruption. In any case, such large-scale errors are rare.

I suggest you also go to the OpenZFS Discussions for help.

The zpool import process choosing to enter at txg=6823467 when it appears all of your labels are synchronized at txg=6814766 is unexpected:

Is it possible to re-run the zdb -l commands to see if any of the long-running import attempts without a -n have been attempting to commit further txgs to pool?

I am also seeing a lot of deadman triggers on slow vdev which are flagging all disks -

1753039207   ffff921191290000 spa_misc.c:668:spa_deadman(): slow spa_sync: started 2941 seconds ago, calls 39
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/ee782483-dfd4-49f1-a537-845bdcd3deab has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039207   ffff921191290000 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/1cc4581f-326e-4645-b0ab-f6b3ba059dcb has 1 active IOs
1753039269   ffff921200b86500 spa_misc.c:668:spa_deadman(): slow spa_sync: started 3003 seconds ago, calls 40
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/05802c1a-a4d3-4120-9f49-3c18de9340e6 has 1 active IOs
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/66b0bdd6-58b1-4959-ae1a-ba84f87d5e70 has 1 active IOs
1753039269   ffff921200b86500 vdev.c:5608:vdev_deadman(): slow vdev: /dev/disk/by-partuuid/a41d1487-ea1e-4b5e-8d3f-e2667151e464 has 1 active IOs

Normally a slow vdev callout pointing to a single disk means that drive specifically is failing - but this appears to be across all members of the vdev, which would usually indicate something common to them - a storage controller, or backplane fault perhaps.

Just to confirm @leng_sok you are not using deduplication on this system at all?

I do see some details on the system configuration in your signature @leng_sok - but I’m having a bit of trouble navigating the board manual - https://www.kdocs.cn/l/ce7ELVW6Jkcr - to determine what the storage controller is, just to confirm that it is using the integrated SATA controller in the Xeon D itself. It does appear to be using the ports on the SoC.

I did find this snippet in the initial section of the manual - machine-translated:

13.SATA口不认的问题:矿龙,长城,和一些奇怪的杂牌小1U、1U、2U电源电源笼和部分大功率电源的80PLUS电源有很大概率会引起部分SATA口不认或全不认的问题,我们装机实用使用振华、益衡完全无任何问题。当出现SATA不认的时候测试方法,先短接启动电源(ATX24针接口中的绿线短路任何一个黑线)然后再按开机如果能认出硬盘就是这个BUG。应该电源启动机制触发了D1581的SATA口的某些机制,毕竟这个CPU正常也不是咱们这么使用的。

  1. The problem of SATA port not being recognized: Kuanglong, Great Wall, and some strange brand-name small 1U, 1U, 2U power supply cages and some high-power 80PLUS power supplies have a high probability of causing some SATA ports to not be recognized or not recognized at all. We install and use Zhenhua and Yiheng without any problems. When SATA is not recognized, the test method is to short-circuit the startup power supply (the green line in the ATX24-pin interface shorts any black line) and then press the power on button. If the hard disk can be recognized, it is this BUG. The power startup mechanism should trigger some mechanisms of the SATA port of D1581. After all, this CPU is not used normally like this.
2 Likes