Manual k8s migration throws "[EFAULT] No backups found for ''tank"

Apps and Virtualization
1

(for this post I will rename my pool to tank and my hostname to machine, but those are not my actual names in usage. I mean it if i miss some replacements)

I have a copy of my old ix-applications in /mnt/tank

machine% ls /mnt/tank/ix-applications
app_migrations.json  backups  catalogs  config.json  default_volumes  k3s  migrations.json  releases

Yet launching

sudo midclt call -job k8s_to_docker.migrate tank

shows

Total Progress: [________________________________________] 0.00%Status: (none)
Total Progress: [________________________________________] 0.00%
[EFAULT] No backups found for 'tank'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 488, in run
    await self.future
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 535, in __run_body
    rv = await self.middleware.run_in_thread(self.method, *args)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1364, in run_in_thread
    return await self.run_in_executor(io_thread_pool_executor, method, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1361, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 183, in nf
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 55, in nf
    res = f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/kubernetes_to_docker/migrate.py", line 64, in migrate
    raise CallError(f'No backups found for {kubernetes_pool!r}')
middlewared.service_exception.CallError: [EFAULT] No backups found for 'tank'

and i have no idea of what that means. Someone can throw any light?

2

I found out in

sudo zfs list -r tank

does not show /mnt/tank/ix-applications/backups

tank/ix-applications                                              38.5G  9.26T  1.21M  /mnt/tank/ix-applications
tank/ix-applications/catalogs                                      106M  9.26T  67.0M  /mnt/tank/ix-applications/catalogs
tank/ix-applications/default_volumes                               170K  9.26T   170K  /mnt/tank/ix-applications/default_volumes
tank/ix-applications/k3s                                          11.8G  9.26T  9.88G  /mnt/tank/ix-applications/k3s
tank/ix-applications/k3s/kubelet                                  1.87G  9.26T   642M  /mnt/tank/ix-applications/k3s/kubelet
tank/ix-applications/releases                                     26.6G  9.26T   185K  /mnt/tank/ix-applications/releases
tank/ix-applications/releases/immich                              26.6G  9.26T   199K  /mnt/tank/ix-applications/releases/immich
tank/ix-applications/releases/immich/charts                       1.57M  9.26T  1.46M  /mnt/tank/ix-applications/releases/immich/charts
tank/ix-applications/releases/immich/volumes                      26.6G  9.26T   185K  /mnt/tank/ix-applications/releases/immich/volumes
tank/ix-applications/releases/immich/volumes/ix_volumes           26.6G  9.26T   256K  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes
tank/ix-applications/releases/immich/volumes/ix_volumes/library    170K  9.26T   170K  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/library
tank/ix-applications/releases/immich/volumes/ix_volumes/pgBackup   192M  9.26T   192M  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/pgBackup
tank/ix-applications/releases/immich/volumes/ix_volumes/pgData     479M  9.26T   479M  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/pgData
tank/ix-applications/releases/immich/volumes/ix_volumes/profile    170K  9.26T   170K  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/profile
tank/ix-applications/releases/immich/volumes/ix_volumes/thumbs    1.98G  9.26T  1.98G  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/thumbs
tank/ix-applications/releases/immich/volumes/ix_volumes/uploads   23.8G  9.26T  23.8G  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/uploads
tank/ix-applications/releases/immich/volumes/ix_volumes/video      176M  9.26T   176M  /mnt/tank/ix-applications/releases/immich/volumes/ix_volumes/video

i have the directory and has files inside tho, but it does not show in the command.

now i need to seek how to properly mount it, i guess. if anyone knows, post below please!

3

Still nothing :frowning:

machine% sudo zfs list -r tank/ix-applications | grep backups
tank/ix-applications/backups                                      1.14M  9.26T  1.14M  /mnt/tank/ix-applications/backups
machine% sudo midclt call -job k8s_to_docker.migrate tank
Status: (none)
Total Progress: [________________________________________] 0.00%
[EFAULT] No backups found for 'tank'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 488, in run
    await self.future
  File "/usr/lib/python3/dist-packages/middlewared/job.py", line 535, in __run_body
    rv = await self.middleware.run_in_thread(self.method, *args)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1364, in run_in_thread
    return await self.run_in_executor(io_thread_pool_executor, method, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1361, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 183, in nf
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 55, in nf
    res = f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/kubernetes_to_docker/migrate.py", line 64, in migrate
    raise CallError(f'No backups found for {kubernetes_pool!r}')
middlewared.service_exception.CallError: [EFAULT] No backups found for 'tank'
machine% sudo ls /mnt/tank/ix-applications/backups
backup_to_tank_2024-08-15_21:43:41  system-update--2024-09-13_06:28:58  system-update--2024-10-06_11:19:22  system-update--2024-10-26_16:53:40

Anyone has any idea on how to proceed?

4

shameless bump? Maybe should have I posted in general? (its actually middleware related, not App related)