Update 24.04.2.3 - 24.10.0.2 Some apps missing

Hi, this is my first post in the forums so I apologise in advance if I make any mistakes.

After update to Electric Eel some of my apps are missing. The migration error log shows the following for each of the missing apps:-

[2024/11/10 13:22:27] (DEBUG) app_migrations.migrate():235 - Migration details for ‘system-update–2024-11-10_00:19:52’ backup on ‘Pool1’ pool
[2024/11/10 13:22:27] (DEBUG) app_migrations.migrate():241 - ‘sonarr’ app failed to migrate successfully: “Failed to clone and promote ix-volumes: [EFAULT] Failed to clone snapshot: cannot create ‘Pool1/ix-apps/app_mounts/sonarr/config’: dataset already exists”

If I try and install Sonarr in Electric Eel it fails to install:-
[EFAULT] Failed to render compose templates: base_v1_1_7.utils.TemplateException: Expected path [Media] to start with /

Traceback (most recent call last):
File “/usr/lib/python3/dist-packages/middlewared/job.py”, line 488, in run
await self.future
File “/usr/lib/python3/dist-packages/middlewared/job.py”, line 535, in __run_body
rv = await self.middleware.run_in_thread(self.method, *args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/main.py”, line 1364, in run_in_thread
return await self.run_in_executor(io_thread_pool_executor, method, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/main.py”, line 1361, in run_in_executor
return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/concurrent/futures/thread.py”, line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/service/crud_service.py”, line 268, in nf
rv = func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/schema/processor.py”, line 55, in nf
res = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/schema/processor.py”, line 183, in nf
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/plugins/apps/crud.py”, line 203, in do_create
return self.create_internal(job, app_name, version, data[‘values’], complete_app_details)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3/dist-packages/middlewared/plugins/apps/crud.py”, line 248, in create_internal
raise e from None
File “/usr/lib/python3/dist-packages/middlewared/plugins/apps/crud.py”, line 233, in create_internal
update_app_config(app_name, version, new_values)
File “/usr/lib/python3/dist-packages/middlewared/plugins/apps/ix_apps/lifecycle.py”, line 59, in update_app_config
render_compose_templates(
File “/usr/lib/python3/dist-packages/middlewared/plugins/apps/ix_apps/lifecycle.py”, line 50, in render_compose_templates
raise CallError(f’Failed to render compose templates: {cp.stderr}')
middlewared.service_exception.CallError: [EFAULT] Failed to render compose templates: base_v1_1_7.utils.TemplateException: Expected path [Media] to start with /

Any help appreciated.

I tried the following:-
I reverted to 24.04.2.3 backed up the apps that were not migrating then deleted them.

I deleted the boot for 24.20.0. 2 the rebooted in 24.04.2.3.

I checked that the apps were no longer showing and then did a fresh update to 24.20.0.2.

I then tried to do a clean install of one of the apps that I had deleted. It failed. The error message given direct me to /var/log/app_lifecycle.log

The error message in the log was:-

(ERROR) app_lifecycle.compose_action():56 - Failed ‘up’ action for ‘prowlarr’ app: prowlarr Pulling
prowlarr Error Head “https://ghcr.io/v2/onedr0p/prowlarr-develop/manifests/1.26.0.4833”: Get “https://ghcr.io/token?scope=repository%3Aonedr0p%2Fprowlarr-develop%3Apull&service=ghcr.io”: dial tcp: lookup ghcr.io on 192.168.2.254:53: no such host
Error response from daemon: Head “https://ghcr.io/v2/onedr0p/prowlarr-develop/manifests/1.26.0.4833”: Get “https://ghcr.io/token?scope=repository%3Aonedr0p%2Fprowlarr-develop%3Apull&service=ghcr.io”: dial tcp: lookup ghcr.io on 192.168.2.254:53: no such host

Thanks for any suggestions of what I could try next.

To provide some more context.

The missing apps are all TrueNas apps and are all up to date.

There is no encryption and ACL boxes are all unticked.

The app that successfully migrates is Plex and its container in 24.04.2.3 is recorded as ‘docker.io/plexinc/pms-docker:plexpass

The apps that fail to migrate have a different container ‘Package prowlarr-develop · GitHub

Running midclt call -job k8s_to_docker.migrate in the shell after upgrade to 24.10.02 results in the following error:-
[{“name”: “radarr”, “error”: “Failed to clone and promote ix-volumes: [EFAULT] Failed to clone snapshot: cannot create ‘Pool1/ix-apps/app_mounts/radarr/config’: dataset already exists”, “successfully_migrated”: false}, {“name”: “prowlarr”, “error”: “Failed to clone and promote ix-volumes: [EFAULT] Failed to clone snapshot: cannot create ‘Pool1/ix-apps/app_mounts/prowlarr/config’: dataset already exists”, “successfully_migrated”: false}, {“name”: “sonarr”, “error”: “Failed to clone and promote ix-volumes: [EFAULT] Failed to clone snapshot: cannot create ‘Pool1/ix-apps/app_mounts/sonarr/config’: dataset already exists”, “successfully_migrated”: false}, {“name”: “sabnzbd”, “error”: “Failed to clone and promote ix-volumes: [EFAULT] Failed to clone snapshot: cannot create ‘Pool1/ix-apps/app_mounts/sabnzbd/config’: dataset already exists”, “successfully_migrated”: false}]
root@milton-nas[~]#