Trying to export pool-Many problems-Please Help!

GreymatterPrison · April 24, 2025, 5:42pm

I am attempting to export my pool to rename it and begin the long process of fixing everything that is linked to that name. I am getting errors for ‘Path does not exist’ and ‘cannot unmount <pool-name/dataset-name> does not exist’.

This is a problem stemming from a previous issue I had, please reference New Pool ACL set as NFSv4-libvirt-qemu Has No Access

I have attempted everything I can based on my knowledge and research, 20 tabs open. I have attempted to zfs destroy some of the snapshots and clones but I either get ‘directory does not exist’ or ‘target device busy’ when trying to unmount.

Please help!

pmh · April 24, 2025, 6:31pm

Please post the exact command you tried and the exact response/error message you got.

GreymatterPrison · April 24, 2025, 6:38pm

For exporting the pool via the GUI:

concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/zfs_/dataset_actions.py", line 70, in umount
    with libzfs.ZFS() as zfs:
  File "libzfs.pyx", line 534, in libzfs.ZFS.__exit__
  File "/usr/lib/python3/dist-packages/middlewared/plugins/zfs_/dataset_actions.py", line 72, in umount
    dataset.umount(force=options['force'])
  File "libzfs.pyx", line 4321, in libzfs.ZFSDataset.umount
libzfs.ZFSException: cannot unmount '/mnt/.ix-apps/app_mounts/jellyfin/transcodes-ix-applications-backup-system-update--2024-11-07_14:38:57-clone': no such pool or dataset

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.11/concurrent/futures/process.py", line 261, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/worker.py", line 116, in main_worker
    res = MIDDLEWARE._run(*call_args)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/worker.py", line 47, in _run
    return self._call(name, serviceobj, methodobj, args, job=job)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/worker.py", line 41, in _call
    return methodobj(*params)
           ^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 178, in nf
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/zfs_/dataset_actions.py", line 75, in umount
    handle_ds_not_found(e.code, name)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/zfs_/dataset_actions.py", line 11, in handle_ds_not_found
    raise CallError(f'Dataset {ds_name!r} not found', errno.ENOENT)
middlewared.service_exception.CallError: [ENOENT] Dataset 'Fast Storage/ix-apps' not found
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 515, in run
    await self.future
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 560, in __run_body
    rv = await self.method(*args)
         ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 174, in nf
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 48, in nf
    res = await f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/pool_/export.py", line 111, in export
    await delegate.delete(attachments)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/docker/attachments.py", line 31, in delete
    await (await self.middleware.call('docker.update', {'pool': None})).wait(raise_error=True)
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 463, in wait
    raise self.exc_info[1]
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 515, in run
    await self.future
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 560, in __run_body
    rv = await self.method(*args)
         ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/api/base/decorator.py", line 88, in wrapped
    result = await func(*args)
             ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/docker/update.py", line 101, in do_update
    catalog_sync_job = await self.middleware.call('docker.fs_manage.umount')
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 977, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 692, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/docker/fs_manage.py", line 33, in umount
    return await self.common_func(False)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/docker/fs_manage.py", line 20, in common_func
    await self.middleware.call('zfs.dataset.umount', docker_ds, {'force': True})
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 977, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 700, in _call
    return await self._call_worker(name, *prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 706, in _call_worker
    return await self.run_in_proc(main_worker, name, args, job)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 612, in run_in_proc
    return await self.run_in_executor(self.__procpool, method, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 596, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
middlewared.service_exception.CallError: [ENOENT] Dataset 'Fast Storage/ix-apps' not found

With
zfs list -t snapshot -o name,clones -r 'Fast Storage'

I get

admin@Johny5[~]$ sudo umount 'Fast Storage'/ix-apps                   
umount: /mnt/.ix-apps: target is busy.

admin@Johny5[~]$ sudo zfs destroy -R 'Fast Storage'/ix-apps/app_mounts/jellyfin/transcodes@ix-applications-backup-system-update--2024-11-07_14:38:57
cannot unmount '/mnt/.ix-apps/app_mounts/jellyfin/transcodes-ix-applications-backup-system-update--2024-11-07_14:38:57-clone': no such pool or dataset
cannot destroy snapshot Fast Storage/ix-apps/app_mounts/jellyfin/transcodes@ix-applications-backup-system-update--2024-11-07_14:38:57: snapshot is cloned

With: sudo nano /proc/mounts
These are listed
Fast\040Storage/ix-apps/app_mounts/jellyfin/transcodes-ix-applications-backup-system-update--2024-11-07_14:38:57-clone /mnt/.ix-apps/app_mounts/jellyfin/transcodes-ix-applications-backup-system-update--2024-11-07_14:38:57-clone zfs rw,noatime,xattr,posixacl,casesensitive 0 0

pmh · April 24, 2025, 7:12pm

Please do not use external hosting sites. Just copy & paste into your forum post inside code tags like so:

this
is
code

Thanks.

To the topic: so if you shutdown all apps, unset the app pool, then try on the command line:

zfs export -f 'Fast Storage'

What happens?

GreymatterPrison · April 24, 2025, 7:22pm

Same error when trying to unset the apps pool
[ENOENT] Dataset ‘Fast Storage/ix-apps’ not found

sudo zfs export -f 'Fast Storage'
unrecognized command 'export'
usage: zfs command args ...

GreymatterPrison · April 24, 2025, 7:32pm

 zpool export -f 'Fast Storage'
cannot unmount '/mnt/.ix-apps/app_mounts/jellyfin/transcodes-ix-applications-backup-system-update--2024-11-07_14:38:57-clone': no such pool or dataset

pmh · April 24, 2025, 7:33pm

Sorry, zpool export ... of course.

newguy123 · April 25, 2025, 3:02pm

maybe try moving the apps to another pool since the ix-apps dataset is giving the issue. then i would reboot just to ensure nothing is trying to access that dataset.

GreymatterPrison · April 25, 2025, 7:31pm

If you mean moving the Apps pool to another, unset then set, that does not work. See the above.

If you mean move the datasets to another pool, replication, that is what got me in this situation with the clones.

GreymatterPrison · April 28, 2025, 3:26pm

I think at this point if I cannot get a solution from anyone I am going to have to destroy the pool and start all over. Not what I want to do but if that is my only option then I will do so.

Would I be able to save the user_config.yaml and use it once I rebuild the pool?

Would Rsync be an option for me to push to another machine, say a Truenas VM on proxmox? Rsync my app configs dataset to the remote machine then destroy the pool on my main machine, rebuild the pool, rsync back from the proxmox VM? If so how would the datasets structure work? Do I need to create the datasets on each side of the rsync or is that done during the sync?

*Replication seems to be the way.

GreymatterPrison · April 29, 2025, 10:23pm

Pool had to be destroyed.

Tried replication but forgot the VM I was replicating to had an encrypted pool so, it complicated the replication back to my main TrueNAS host. Ultimately replication to another host would have been the best option considering the issues with snapshot clones.

I created an SMB share and saved all my app data to a zip file and just rebuilt the pool over the last 24 hours.

I was able to unmount the datasets to get the pool to export via the webui. Instead of using an umount -f /path/to/dataset I needed to use umount -l /path/to/dataset as root.