Apps and Docker not starting in TrueNas Scale ElectricEel-24.10.0.2

I do not know exactly how and when it happened but at some point my apps all stopped working and are not starting at all in truenas

This is the error message i get from TureNas:

Critical

Failed to start docker for Applications: Docker service could not be started

This i get when checking in the Shell:


sudo systemctl status docker                                                               

[sudo] password for admin: 
Γ— docker.service - Docker Application Container Engine
     Loaded: loaded (/lib/systemd/system/docker.service; disabled; preset: disabled)
    Drop-In: /etc/systemd/system/docker.service.d
             └─override.conf
     Active: failed (Result: exit-code) since Tue 2024-12-17 00:18:35 CET; 1min 56s ago
TriggeredBy: Γ— docker.socket
    Process: 12786 ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock (code=exited, status=1/FAILURE)
   Main PID: 12786 (code=exited, status=1/FAILURE)
        CPU: 699ms

Dec 17 00:18:35 truenas systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
Dec 17 00:18:35 truenas systemd[1]: Stopped docker.service - Docker Application Container Engine.
Dec 17 00:18:35 truenas systemd[1]: docker.service: Start request repeated too quickly.
Dec 17 00:18:35 truenas systemd[1]: docker.service: Failed with result 'exit-code'.
Dec 17 00:18:35 truenas systemd[1]: Failed to start docker.service - Docker Application Container Engine.

this i get when digging deeper


sudo journalctl -xe


β–‘β–‘ Subject: Unit process exited
β–‘β–‘ Defined-By: systemd
β–‘β–‘ An ExecStart= process belonging to unit docker.service has exited.
β–‘β–‘ 
β–‘β–‘ The process' exit code is 'exited' and its exit status is 1.
Dec 17 00:27:38 truenas systemd[1]: docker.service: Failed with result 'exit-code'.
β–‘β–‘ Subject: Unit failed
β–‘β–‘ Defined-By: systemd
β–‘β–‘ The unit docker.service has entered the 'failed' state with result 'exit-code'.
Dec 17 00:27:38 truenas systemd[1]: Failed to start docker.service - Docker Application Container Engine.
β–‘β–‘ Subject: A start job for unit docker.service has failed
β–‘β–‘ Defined-By: systemd
β–‘β–‘ A start job for unit docker.service has finished with a failure.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3013 and the job result is failed.
Dec 17 00:27:38 truenas sudo[13265]: pam_unix(sudo:session): session closed for user root
Dec 17 00:27:40 truenas systemd[1]: docker.service: Scheduled restart job, restart counter is at 1.
β–‘β–‘ Subject: Automatic restarting of a unit has been scheduled
β–‘β–‘ Defined-By: systemd
β–‘β–‘ Automatic restarting of the unit docker.service has been scheduled, as the result for
β–‘β–‘ the configured Restart= setting for the unit.
Dec 17 00:27:40 truenas systemd[1]: Stopped docker.service - Docker Application Container Engine.
β–‘β–‘ Subject: A stop job for unit docker.service has finished
β–‘β–‘ Defined-By: systemd
β–‘β–‘ A stop job for unit docker.service has finished.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3085 and the job result is done.
Dec 17 00:27:40 truenas systemd[1]: Starting docker.service - Docker Application Container Engine...
β–‘β–‘ Subject: A start job for unit docker.service has begun execution
β–‘β–‘ Defined-By: systemd
β–‘β–‘ 
β–‘β–‘ A start job for unit docker.service has begun execution.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3085.
Dec 17 00:27:40 truenas dockerd[13486]: time="2024-12-17T00:27:40.380706306+01:00" level=info msg="Starting up"
Dec 17 00:27:41 truenas dockerd[13486]: time="2024-12-17T00:27:41.515721632+01:00" level=info msg="[graphdriver] trying configured driver: overlay2"
Dec 17 00:27:44 truenas systemd[1]: mnt-.ix\x2dapps-docker-overlay2-metacopy\x2dcheck131454234-merged.mount: Deactivated successfully.
β–‘β–‘ Subject: Unit succeeded
β–‘β–‘ Defined-By: systemd
β–‘β–‘ 
β–‘β–‘ The unit mnt-.ix\x2dapps-docker-overlay2-metacopy\x2dcheck131454234-merged.mount has successfully entered the 'dead' state.
Dec 17 00:27:45 truenas dockerd[13486]: time="2024-12-17T00:27:45.398698328+01:00" level=info msg="Loading containers: start."
Dec 17 00:27:52 truenas dockerd[13486]: time="2024-12-17T00:27:52.293850161+01:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.16.0>
Dec 17 00:27:52 truenas dockerd[13486]: time="2024-12-17T00:27:52.298282245+01:00" level=info msg="stopping event stream following graceful shutdown" error="<nil>">
Dec 17 00:27:52 truenas dockerd[13486]: failed to start daemon: Error initializing network controller: error creating default "bridge" network: cannot create netwo>
Dec 17 00:27:52 truenas systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
β–‘β–‘ Subject: Unit process exited
β–‘β–‘ Defined-By: systemd 
β–‘β–‘ An ExecStart= process belonging to unit docker.service has exited.
β–‘β–‘ 
β–‘β–‘ The process' exit code is 'exited' and its exit status is 1.
Dec 17 00:27:52 truenas systemd[1]: docker.service: Failed with result 'exit-code'.
β–‘β–‘ Subject: Unit failed
β–‘β–‘ Defined-By: systemd
β–‘β–‘ The unit docker.service has entered the 'failed' state with result 'exit-code'.
Dec 17 00:27:52 truenas systemd[1]: Failed to start docker.service - Docker Application Container Engine.
β–‘β–‘ Subject: A start job for unit docker.service has failed
β–‘β–‘ Defined-By: systemd
β–‘β–‘ A start job for unit docker.service has finished with a failure.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3085 and the job result is failed.
Dec 17 00:27:54 truenas systemd[1]: docker.service: Scheduled restart job, restart counter is at 2.
β–‘β–‘ Subject: Automatic restarting of a unit has been scheduled
β–‘β–‘ Defined-By: systemd
β–‘β–‘ Automatic restarting of the unit docker.service has been scheduled, as the result for
β–‘β–‘ the configured Restart= setting for the unit.
Dec 17 00:27:54 truenas systemd[1]: Stopped docker.service - Docker Application Container Engine.
β–‘β–‘ Subject: A stop job for unit docker.service has finished
β–‘β–‘ Defined-By: systemd
β–‘β–‘ A stop job for unit docker.service has finished.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3157 and the job result is done.
Dec 17 00:27:54 truenas systemd[1]: Starting docker.service - Docker Application Container Engine...
β–‘β–‘ Subject: A start job for unit docker.service has begun execution
β–‘β–‘ Defined-By: systemd
β–‘β–‘ A start job for unit docker.service has begun execution.
β–‘β–‘ 
β–‘β–‘ The job identifier is 3157.
Dec 17 00:27:54 truenas dockerd[13699]: time="2024-12-17T00:27:54.377635015+01:00" level=info msg="Starting up"
Dec 17 00:27:59 truenas sudo[13733]: @cee:{"sudo":{"accept":{"uuid":"de4fd32d38-ddb6-45a3-443d-3d30c9625c","server_time":{"seconds":1734391679,"nanoseconds":532238>
Dec 17 00:27:59 truenas sudo[13733]: pam_unix(sudo:session): session opened for user root(uid=0) by admin(uid=950)

as well as


sudo dockerd --debug                                                            

INFO[2024-12-17T00:33:23.060292517+01:00] Starting up                                  
DEBU[2024-12-17T00:33:23.060882788+01:00] Listener created for HTTP on unix (/var/run/docker.sock) 
DEBU[2024-12-17T00:33:23.066187918+01:00] Golang's threads limit set to 227070         
DEBU[2024-12-17T00:33:23.066375343+01:00] metrics API listening on /var/run/docker/metrics.sock 
DEBU[2024-12-17T00:33:23.067465501+01:00] Using default logging driver json-file       
DEBU[2024-12-17T00:33:23.067558934+01:00] processing event stream                       module=libcontainerd namespace=plugins.moby
DEBU[2024-12-17T00:33:23.067691178+01:00] No quota support for local volumes in /mnt/.ix-apps/docker/volumes: Filesystem does not support, or has not enabled quotas 
INFO[2024-12-17T00:33:24.466594045+01:00] [graphdriver] trying configured driver: overlay2 
DEBU[2024-12-17T00:33:26.881576349+01:00] successfully detected metacopy status         storage-driver=overlay2 usingMetacopy=false
DEBU[2024-12-17T00:33:27.874100110+01:00] backingFs=zfs, projectQuotaSupported=false, usingMetacopy=false, indexOff="index=off,", userxattr=""  storage-driver=overlay2
DEBU[2024-12-17T00:33:27.874165785+01:00] Initialized graph driver overlay2            
DEBU[2024-12-17T00:33:27.900870336+01:00] Max Concurrent Downloads: 3                  
DEBU[2024-12-17T00:33:27.900884111+01:00] Max Concurrent Uploads: 5                    
DEBU[2024-12-17T00:33:27.900887304+01:00] Max Download Attempts: 5                     
INFO[2024-12-17T00:33:27.900895017+01:00] Loading containers: start.                   
DEBU[2024-12-17T00:33:27.901011904+01:00] processing event stream                       module=libcontainerd namespace=moby
DEBU[2024-12-17T00:33:27.902408906+01:00] loaded container                              container=06bff1f83d7e2375e555fb64898dfc0541ff8c7828f964f4253a978bb72435df paused=false running=false
DEBU[2024-12-17T00:33:27.902417159+01:00] loaded container                              container=b83e25b91be59c985f85dd88cdd734db458480805d654d07b60464270b03ab44 paused=false running=false
DEBU[2024-12-17T00:33:27.902419276+01:00] loaded container                              container=8c806c6d39e3e08a1f151c31cce87ef47d0d0d763ebd46e0ab7ddd8d338ac396 paused=false running=false
DEBU[2024-12-17T00:33:27.902494724+01:00] loaded container                              container=35a06b72d4fe0129f55d86c657e48573ee8b2116f928ab1b67b1cacd8e89f1ac paused=false running=false
DEBU[2024-12-17T00:33:27.902503652+01:00] loaded container                              container=38a941c28b3a344ec85a6616d662c46c643ce2baa8755375ebf0ea8e7921ce77 paused=false running=false
DEBU[2024-12-17T00:33:27.902558040+01:00] loaded container                              container=0bed7c9899c4d7a2df96fd11d12b7df52dbd8b8bfa666bdaf50c308517abd4a2 paused=false running=false
DEBU[2024-12-17T00:33:27.902589121+01:00] loaded container                              container=9a615323c8083f8368d9c0a65a6d9aeda22a3e2fcd30cc465839bdb249189057 paused=false running=false
DEBU[2024-12-17T00:33:27.902588948+01:00] loaded container                              container=39080773c5291db38436170f75c9f38693bded255c83d09d6d0c3659f7deeed3 paused=false running=false
DEBU[2024-12-17T00:33:27.902568929+01:00] loaded container                              container=f380cb65fb2ca8f48423c95b2477b4d8462c30d7e0c18e9b5203446e4f889557 paused=false running=false
DEBU[2024-12-17T00:33:27.902596714+01:00] loaded container                              container=ac86969a4a64eaa52ebb0c6a23294cd75d13ae61f39c9024d7202fa51a566665 paused=false running=false
DEBU[2024-12-17T00:33:27.902729555+01:00] loaded container                              container=aa5d044e4bb05749454d604d76cb8c7d5704c2b21ce203b8d46eb1e6c7c1adc7 paused=false running=false
DEBU[2024-12-17T00:33:27.902769409+01:00] loaded container                              container=e1221ec2575f26dad59c2805683d82013ef1c8221c1f36ca96448c465c46b1a5 paused=false running=false
DEBU[2024-12-17T00:33:27.902794893+01:00] loaded container                              container=0644260c98ad6e0abae7627e88d54be2fedde24033b71bab923f2cad0115c622 paused=false running=false
DEBU[2024-12-17T00:33:34.640262646+01:00] restoring container                           container=e1221ec2575f26dad59c2805683d82013ef1c8221c1f36ca96448c465c46b1a5 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640326710+01:00] restoring container                           container=aa5d044e4bb05749454d604d76cb8c7d5704c2b21ce203b8d46eb1e6c7c1adc7 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640626627+01:00] restoring container                           container=06bff1f83d7e2375e555fb64898dfc0541ff8c7828f964f4253a978bb72435df paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640583233+01:00] restoring container                           container=39080773c5291db38436170f75c9f38693bded255c83d09d6d0c3659f7deeed3 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640573412+01:00] restoring container                           container=38a941c28b3a344ec85a6616d662c46c643ce2baa8755375ebf0ea8e7921ce77 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640889490+01:00] restoring container                           container=0bed7c9899c4d7a2df96fd11d12b7df52dbd8b8bfa666bdaf50c308517abd4a2 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640810058+01:00] restoring container                           container=9a615323c8083f8368d9c0a65a6d9aeda22a3e2fcd30cc465839bdb249189057 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.641651690+01:00] restoring container                           container=ac86969a4a64eaa52ebb0c6a23294cd75d13ae61f39c9024d7202fa51a566665 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.641775197+01:00] restoring container                           container=0644260c98ad6e0abae7627e88d54be2fedde24033b71bab923f2cad0115c622 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.641909586+01:00] restoring container                           container=35a06b72d4fe0129f55d86c657e48573ee8b2116f928ab1b67b1cacd8e89f1ac paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.642676087+01:00] done restoring container                      container=38a941c28b3a344ec85a6616d662c46c643ce2baa8755375ebf0ea8e7921ce77 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.640851794+01:00] restoring container                           container=b83e25b91be59c985f85dd88cdd734db458480805d654d07b60464270b03ab44 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.642849808+01:00] done restoring container                      container=e1221ec2575f26dad59c2805683d82013ef1c8221c1f36ca96448c465c46b1a5 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643056466+01:00] done restoring container                      container=39080773c5291db38436170f75c9f38693bded255c83d09d6d0c3659f7deeed3 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643232722+01:00] done restoring container                      container=aa5d044e4bb05749454d604d76cb8c7d5704c2b21ce203b8d46eb1e6c7c1adc7 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.641023373+01:00] restoring container                           container=8c806c6d39e3e08a1f151c31cce87ef47d0d0d763ebd46e0ab7ddd8d338ac396 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643454309+01:00] done restoring container                      container=0644260c98ad6e0abae7627e88d54be2fedde24033b71bab923f2cad0115c622 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643574867+01:00] done restoring container                      container=35a06b72d4fe0129f55d86c657e48573ee8b2116f928ab1b67b1cacd8e89f1ac paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643658180+01:00] done restoring container                      container=06bff1f83d7e2375e555fb64898dfc0541ff8c7828f964f4253a978bb72435df paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643897227+01:00] done restoring container                      container=9a615323c8083f8368d9c0a65a6d9aeda22a3e2fcd30cc465839bdb249189057 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643921896+01:00] done restoring container                      container=b83e25b91be59c985f85dd88cdd734db458480805d654d07b60464270b03ab44 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.643716515+01:00] done restoring container                      container=ac86969a4a64eaa52ebb0c6a23294cd75d13ae61f39c9024d7202fa51a566665 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.644151757+01:00] done restoring container                      container=0bed7c9899c4d7a2df96fd11d12b7df52dbd8b8bfa666bdaf50c308517abd4a2 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.645878216+01:00] done restoring container                      container=8c806c6d39e3e08a1f151c31cce87ef47d0d0d763ebd46e0ab7ddd8d338ac396 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.689211786+01:00] restoring container                           container=f380cb65fb2ca8f48423c95b2477b4d8462c30d7e0c18e9b5203446e4f889557 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.690132873+01:00] done restoring container                      container=f380cb65fb2ca8f48423c95b2477b4d8462c30d7e0c18e9b5203446e4f889557 paused=false restarting=false running=false
DEBU[2024-12-17T00:33:34.690328055+01:00] Option DefaultDriver: bridge                 
DEBU[2024-12-17T00:33:34.690381103+01:00] Option DefaultNetwork: bridge                
DEBU[2024-12-17T00:33:34.690395875+01:00] Network Control Plane MTU: 1500              
DEBU[2024-12-17T00:33:34.698641915+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:34.702604411+01:00] /sbin/iptables, [--wait -t nat -D PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:34.738262434+01:00] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL ! --dst 127.0.0.0/8 -j DOCKER] 
DEBU[2024-12-17T00:33:34.790227290+01:00] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:34.794786123+01:00] /sbin/iptables, [--wait -t nat -D PREROUTING] 
DEBU[2024-12-17T00:33:34.798623897+01:00] /sbin/iptables, [--wait -t nat -D OUTPUT]    
DEBU[2024-12-17T00:33:34.802163008+01:00] /sbin/iptables, [--wait -t nat -F DOCKER]    
DEBU[2024-12-17T00:33:34.834273140+01:00] /sbin/iptables, [--wait -t nat -X DOCKER]    
DEBU[2024-12-17T00:33:34.889903122+01:00] /sbin/iptables, [--wait -t filter -F DOCKER] 
DEBU[2024-12-17T00:33:34.893380219+01:00] /sbin/iptables, [--wait -t filter -X DOCKER] 
DEBU[2024-12-17T00:33:34.934275595+01:00] /sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:34.954246268+01:00] /sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:34.974103087+01:00] /sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:34.994194478+01:00] /sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.014207945+01:00] /sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:35.018285837+01:00] /sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:35.021835043+01:00] /sbin/iptables, [--wait -t nat -n -L DOCKER] 
DEBU[2024-12-17T00:33:35.025145829+01:00] /sbin/iptables, [--wait -t nat -N DOCKER]    
DEBU[2024-12-17T00:33:35.028322304+01:00] /sbin/iptables, [--wait -t filter -n -L DOCKER] 
DEBU[2024-12-17T00:33:35.031863093+01:00] /sbin/iptables, [--wait -t filter -n -L DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.035184535+01:00] /sbin/iptables, [--wait -t filter -n -L DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.038459006+01:00] /sbin/iptables, [--wait -t filter -N DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.041383466+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -j RETURN] 
DEBU[2024-12-17T00:33:35.045037303+01:00] /sbin/iptables, [--wait -A DOCKER-ISOLATION-STAGE-1 -j RETURN] 
DEBU[2024-12-17T00:33:35.048319772+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -j RETURN] 
DEBU[2024-12-17T00:33:35.051891749+01:00] /sbin/iptables, [--wait -A DOCKER-ISOLATION-STAGE-2 -j RETURN] 
DEBU[2024-12-17T00:33:35.054836890+01:00] /sbin/ip6tables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:35.057955908+01:00] /sbin/ip6tables, [--wait -t nat -D PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.061004916+01:00] /sbin/ip6tables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL ! --dst ::1/128 -j DOCKER] 
DEBU[2024-12-17T00:33:35.064230861+01:00] /sbin/ip6tables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.067448844+01:00] /sbin/ip6tables, [--wait -t nat -D PREROUTING] 
DEBU[2024-12-17T00:33:35.070159864+01:00] /sbin/ip6tables, [--wait -t nat -D OUTPUT]   
DEBU[2024-12-17T00:33:35.073407248+01:00] /sbin/ip6tables, [--wait -t nat -F DOCKER]   
DEBU[2024-12-17T00:33:35.076131669+01:00] /sbin/ip6tables, [--wait -t nat -X DOCKER]   
DEBU[2024-12-17T00:33:35.110361599+01:00] /sbin/ip6tables, [--wait -t filter -F DOCKER] 
DEBU[2024-12-17T00:33:35.114073402+01:00] /sbin/ip6tables, [--wait -t filter -X DOCKER] 
DEBU[2024-12-17T00:33:35.142276300+01:00] /sbin/ip6tables, [--wait -t filter -F DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.186186841+01:00] /sbin/ip6tables, [--wait -t filter -X DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.222304869+01:00] /sbin/ip6tables, [--wait -t filter -F DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.254257544+01:00] /sbin/ip6tables, [--wait -t filter -X DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.290170455+01:00] /sbin/ip6tables, [--wait -t filter -F DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:35.294173005+01:00] /sbin/ip6tables, [--wait -t filter -X DOCKER-ISOLATION] 
DEBU[2024-12-17T00:33:35.297975326+01:00] /sbin/ip6tables, [--wait -t nat -n -L DOCKER] 
DEBU[2024-12-17T00:33:35.301367522+01:00] /sbin/ip6tables, [--wait -t nat -N DOCKER]   
DEBU[2024-12-17T00:33:35.304572207+01:00] /sbin/ip6tables, [--wait -t filter -n -L DOCKER] 
DEBU[2024-12-17T00:33:35.308068785+01:00] /sbin/ip6tables, [--wait -t filter -N DOCKER] 
DEBU[2024-12-17T00:33:35.311216981+01:00] /sbin/ip6tables, [--wait -t filter -n -L DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.314131851+01:00] /sbin/ip6tables, [--wait -t filter -N DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.316935625+01:00] /sbin/ip6tables, [--wait -t filter -n -L DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.319715581+01:00] /sbin/ip6tables, [--wait -t filter -N DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.322662295+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -j RETURN] 
DEBU[2024-12-17T00:33:35.325608410+01:00] /sbin/ip6tables, [--wait -A DOCKER-ISOLATION-STAGE-1 -j RETURN] 
DEBU[2024-12-17T00:33:35.328674670+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -j RETURN] 
DEBU[2024-12-17T00:33:35.331797389+01:00] /sbin/ip6tables, [--wait -A DOCKER-ISOLATION-STAGE-2 -j RETURN] 
DEBU[2024-12-17T00:33:35.334765940+01:00] /sbin/ip6tables, [--wait -t filter -P FORWARD DROP] 
DEBU[2024-12-17T00:33:35.371150150+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.16.0.0/24 ! -o docker0 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.375051472+01:00] /sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN] 
DEBU[2024-12-17T00:33:35.378512799+01:00] /sbin/iptables, [--wait -t nat -I DOCKER -i docker0 -j RETURN] 
DEBU[2024-12-17T00:33:35.381796394+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -m addrtype --src-type LOCAL -o docker0 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.385684334+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j DROP] 
DEBU[2024-12-17T00:33:35.389363454+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.392858604+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.396522186+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.399969164+01:00] /sbin/iptables, [--wait -t nat -A PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.403137274+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.406599617+01:00] /sbin/iptables, [--wait -t nat -A OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.409972883+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[2024-12-17T00:33:35.413305744+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[2024-12-17T00:33:35.416156122+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.419192137+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.422301423+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.425230746+01:00] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.474059068+01:00] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.478096762+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i docker0 ! -o docker0 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.481575317+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i docker0 ! -o docker0 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.482463882+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o docker0 -j DROP] 
DEBU[2024-12-17T00:33:35.483827725+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o docker0 -j DROP] 
DEBU[2024-12-17T00:33:35.487107397+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i docker0 ! -o docker0 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.490579969+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i docker0 ! -o docker0 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.493695227+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o docker0 -j DROP] 
DEBU[2024-12-17T00:33:35.497066476+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o docker0 -j DROP] 
DEBU[2024-12-17T00:33:35.500258442+01:00] Network (430bf5d) restored                   
DEBU[2024-12-17T00:33:35.500500987+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.16.3.0/24 ! -o br-53ac1cacef23 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.504120490+01:00] /sbin/iptables, [--wait -t nat -C DOCKER -i br-53ac1cacef23 -j RETURN] 
DEBU[2024-12-17T00:33:35.507511901+01:00] /sbin/iptables, [--wait -t nat -I DOCKER -i br-53ac1cacef23 -j RETURN] 
DEBU[2024-12-17T00:33:35.510751191+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -m addrtype --src-type LOCAL -o br-53ac1cacef23 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.514459067+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-53ac1cacef23 -o br-53ac1cacef23 -j DROP] 
DEBU[2024-12-17T00:33:35.517947845+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-53ac1cacef23 -o br-53ac1cacef23 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.521548153+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-53ac1cacef23 ! -o br-53ac1cacef23 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.525026461+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.528750423+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.532251050+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.535676728+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.539235826+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-53ac1cacef23 -j DOCKER] 
DEBU[2024-12-17T00:33:35.543096174+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-53ac1cacef23 -j DOCKER] 
DEBU[2024-12-17T00:33:35.546784365+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-53ac1cacef23 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.550471373+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-53ac1cacef23 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.553997162+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.557177416+01:00] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.610102155+01:00] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.614108813+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-53ac1cacef23 ! -o br-53ac1cacef23 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.618073845+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-53ac1cacef23 ! -o br-53ac1cacef23 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.621883198+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-53ac1cacef23 -j DROP] 
DEBU[2024-12-17T00:33:35.625123726+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-53ac1cacef23 -j DROP] 
DEBU[2024-12-17T00:33:35.628493445+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-53ac1cacef23 ! -o br-53ac1cacef23 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.632113218+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-53ac1cacef23 ! -o br-53ac1cacef23 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.635288653+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-53ac1cacef23 -j DROP] 
DEBU[2024-12-17T00:33:35.638767566+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-53ac1cacef23 -j DROP] 
DEBU[2024-12-17T00:33:35.642156155+01:00] Network (53ac1ca) restored                   
DEBU[2024-12-17T00:33:35.642395539+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.16.1.0/24 ! -o br-ba97ada10526 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.646115076+01:00] /sbin/iptables, [--wait -t nat -C DOCKER -i br-ba97ada10526 -j RETURN] 
DEBU[2024-12-17T00:33:35.649409595+01:00] /sbin/iptables, [--wait -t nat -I DOCKER -i br-ba97ada10526 -j RETURN] 
DEBU[2024-12-17T00:33:35.652418468+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -m addrtype --src-type LOCAL -o br-ba97ada10526 -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.656067421+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-ba97ada10526 -o br-ba97ada10526 -j DROP] 
DEBU[2024-12-17T00:33:35.659762927+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-ba97ada10526 -o br-ba97ada10526 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.663296727+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-ba97ada10526 ! -o br-ba97ada10526 -j ACCEPT] 
DEBU[2024-12-17T00:33:35.666861184+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.670294374+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.673658139+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.677079238+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.680425126+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-ba97ada10526 -j DOCKER] 
DEBU[2024-12-17T00:33:35.684008042+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-ba97ada10526 -j DOCKER] 
DEBU[2024-12-17T00:33:35.687510577+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-ba97ada10526 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.691189118+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-ba97ada10526 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.694772017+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.697959810+01:00] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.734207196+01:00] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.738147516+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-ba97ada10526 ! -o br-ba97ada10526 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.742266244+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-ba97ada10526 ! -o br-ba97ada10526 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.745782465+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-ba97ada10526 -j DROP] 
DEBU[2024-12-17T00:33:35.749196241+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-ba97ada10526 -j DROP] 
DEBU[2024-12-17T00:33:35.752019164+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-ba97ada10526 ! -o br-ba97ada10526 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.755431519+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-ba97ada10526 ! -o br-ba97ada10526 -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.758606113+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-ba97ada10526 -j DROP] 
DEBU[2024-12-17T00:33:35.761913057+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-ba97ada10526 -j DROP] 
DEBU[2024-12-17T00:33:35.765196353+01:00] Network (ba97ada) restored                   
DEBU[2024-12-17T00:33:35.765513305+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.16.2.0/24 ! -o br-bbdfd66d8fbe -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.768813279+01:00] /sbin/iptables, [--wait -t nat -C DOCKER -i br-bbdfd66d8fbe -j RETURN] 
DEBU[2024-12-17T00:33:35.772152937+01:00] /sbin/iptables, [--wait -t nat -I DOCKER -i br-bbdfd66d8fbe -j RETURN] 
DEBU[2024-12-17T00:33:35.775218804+01:00] /sbin/iptables, [--wait -t nat -C POSTROUTING -m addrtype --src-type LOCAL -o br-bbdfd66d8fbe -j MASQUERADE] 
DEBU[2024-12-17T00:33:35.778762924+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-bbdfd66d8fbe -o br-bbdfd66d8fbe -j DROP] 
DEBU[2024-12-17T00:33:35.782230513+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-bbdfd66d8fbe -o br-bbdfd66d8fbe -j ACCEPT] 
DEBU[2024-12-17T00:33:35.785878363+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -i br-bbdfd66d8fbe ! -o br-bbdfd66d8fbe -j ACCEPT] 
DEBU[2024-12-17T00:33:35.789528086+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.792979386+01:00] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[2024-12-17T00:33:35.796587209+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.800021803+01:00] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[2024-12-17T00:33:35.803412099+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-bbdfd66d8fbe -j DOCKER] 
DEBU[2024-12-17T00:33:35.806961467+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-bbdfd66d8fbe -j DOCKER] 
DEBU[2024-12-17T00:33:35.810537150+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-bbdfd66d8fbe -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.814108652+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -o br-bbdfd66d8fbe -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[2024-12-17T00:33:35.817654942+01:00] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.820794291+01:00] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.854297843+01:00] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION-STAGE-1] 
DEBU[2024-12-17T00:33:35.858160233+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-bbdfd66d8fbe ! -o br-bbdfd66d8fbe -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.862219882+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-bbdfd66d8fbe ! -o br-bbdfd66d8fbe -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.865715817+01:00] /sbin/ip6tables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-bbdfd66d8fbe -j DROP] 
DEBU[2024-12-17T00:33:35.868962311+01:00] /sbin/ip6tables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-bbdfd66d8fbe -j DROP] 
DEBU[2024-12-17T00:33:35.872014932+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-1 -i br-bbdfd66d8fbe ! -o br-bbdfd66d8fbe -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.875361598+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-1 -i br-bbdfd66d8fbe ! -o br-bbdfd66d8fbe -j DOCKER-ISOLATION-STAGE-2] 
DEBU[2024-12-17T00:33:35.878326585+01:00] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION-STAGE-2 -o br-bbdfd66d8fbe -j DROP] 
DEBU[2024-12-17T00:33:35.881513720+01:00] /sbin/iptables, [--wait -t filter -I DOCKER-ISOLATION-STAGE-2 -o br-bbdfd66d8fbe -j DROP] 
DEBU[2024-12-17T00:33:35.884624199+01:00] Network (bbdfd66) restored                   
DEBU[2024-12-17T00:33:35.884912456+01:00] Endpoint (960ba03) restored to network (ba97ada) 
DEBU[2024-12-17T00:33:35.885871098+01:00] Allocating IPv4 pools for network ix-nextcloud_default (53ac1cacef23e988588548a9c4590e196dfad33077caf8493babda220b30ab80) 
DEBU[2024-12-17T00:33:35.886145212+01:00] RequestPool: {AddressSpace:LocalDefault Pool:172.16.3.0/24 SubPool: Options:map[] Exclude:[172.16.0.0/24 172.16.1.0/24 172.16.2.0/24 172.16.3.0/24 192.168.255.0/24 192.168.255.1/32] V6:false} 
DEBU[2024-12-17T00:33:35.886494020+01:00] RequestAddress(LocalDefault/172.16.3.0/24, 172.16.3.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[2024-12-17T00:33:35.886831190+01:00] Request address PoolID:172.16.3.0/24 Bits: 256, Unselected: 254, Sequence: (0x80000000, 1)->(0x0, 6)->(0x1, 1)->end Curr:0 Serial:false PrefAddress:172.16.3.1  
DEBU[2024-12-17T00:33:35.886871296+01:00] Allocating IPv4 pools for network ix-immich_default (ba97ada10526bfe35b657bc7cde827794d19aa061fe07378dfdf5bf73dd97fec) 
DEBU[2024-12-17T00:33:35.887038830+01:00] RequestPool: {AddressSpace:LocalDefault Pool:172.16.1.0/24 SubPool: Options:map[] Exclude:[172.16.0.0/24 172.16.1.0/24 172.16.2.0/24 172.16.3.0/24 192.168.255.0/24 192.168.255.1/32] V6:false} 
DEBU[2024-12-17T00:33:35.887070264+01:00] RequestAddress(LocalDefault/172.16.1.0/24, 172.16.1.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[2024-12-17T00:33:35.887097875+01:00] Request address PoolID:172.16.1.0/24 Bits: 256, Unselected: 254, Sequence: (0x80000000, 1)->(0x0, 6)->(0x1, 1)->end Curr:0 Serial:false PrefAddress:172.16.1.1  
DEBU[2024-12-17T00:33:35.887128820+01:00] Allocating IPv4 pools for network ix-plex_default (bbdfd66d8fbe3e4a91ce2776964e9191aaf8ca27b761c6fd1dbb2a8fc3f5a15f) 
DEBU[2024-12-17T00:33:35.887256727+01:00] RequestPool: {AddressSpace:LocalDefault Pool:172.16.2.0/24 SubPool: Options:map[] Exclude:[172.16.0.0/24 172.16.1.0/24 172.16.2.0/24 172.16.3.0/24 192.168.255.0/24 192.168.255.1/32] V6:false} 
DEBU[2024-12-17T00:33:35.887283796+01:00] RequestAddress(LocalDefault/172.16.2.0/24, 172.16.2.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[2024-12-17T00:33:35.887306941+01:00] Request address PoolID:172.16.2.0/24 Bits: 256, Unselected: 254, Sequence: (0x80000000, 1)->(0x0, 6)->(0x1, 1)->end Curr:0 Serial:false PrefAddress:172.16.2.1  
INFO[2024-12-17T00:33:35.887736028+01:00] Default bridge (docker0) is assigned with an IP address 172.16.0.0/24. Daemon option --bip can be used to set a preferred IP address 
DEBU[2024-12-17T00:33:35.887793701+01:00] Allocating IPv4 pools for network bridge (887fdea20c91edfef0264b0938daebf2384b021cccee1939bf749b2ee628366e) 
DEBU[2024-12-17T00:33:35.887932061+01:00] RequestPool: {AddressSpace:LocalDefault Pool:172.16.0.0/24 SubPool: Options:map[] Exclude:[172.16.0.0/24 172.16.1.0/24 172.16.2.0/24 172.16.3.0/24 192.168.255.0/24 192.168.255.1/32] V6:false} 
DEBU[2024-12-17T00:33:35.887961160+01:00] RequestAddress(LocalDefault/172.16.0.0/24, 172.16.0.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[2024-12-17T00:33:35.887984854+01:00] Request address PoolID:172.16.0.0/24 Bits: 256, Unselected: 254, Sequence: (0x80000000, 1)->(0x0, 6)->(0x1, 1)->end Curr:0 Serial:false PrefAddress:172.16.0.1  
DEBU[2024-12-17T00:33:35.888140129+01:00] releasing IPv4 pools from network bridge (887fdea20c91edfef0264b0938daebf2384b021cccee1939bf749b2ee628366e) 
DEBU[2024-12-17T00:33:35.888157112+01:00] ReleaseAddress(LocalDefault/172.16.0.0/24, 172.16.0.1) 
DEBU[2024-12-17T00:33:35.888179636+01:00] Released address Address:172.16.0.1 Sequence:Bits: 256, Unselected: 254, Sequence: (0x80000000, 1)->(0x0, 6)->(0x1, 1)->end Curr:0 
DEBU[2024-12-17T00:33:35.888194148+01:00] ReleasePool(LocalDefault/172.16.0.0/24)      
DEBU[2024-12-17T00:33:35.888231714+01:00] daemon configured with a 15 seconds minimum shutdown timeout 
DEBU[2024-12-17T00:33:35.888536264+01:00] start clean shutdown of all containers with a 15 seconds timeout... 
DEBU[2024-12-17T00:33:35.891935454+01:00] Unix socket /var/run/docker/libnetwork/8e8a96f415fd.sock was closed. The external key listener will stop. 
DEBU[2024-12-17T00:33:35.892455047+01:00] Cleaning up old mountid : start.             
INFO[2024-12-17T00:33:35.892560052+01:00] stopping event stream following graceful shutdown  error="<nil>" module=libcontainerd namespace=moby
DEBU[2024-12-17T00:33:35.893808528+01:00] Cleaning up old mountid : done.              
failed to start daemon: Error initializing network controller: error creating default "bridge" network: cannot create network 887fdea20c91edfef0264b0938daebf2384b021cccee1939bf749b2ee628366e (docker0): conflicts with network 430bf5d56cfbe36013e031aa964b698d98c871f9221fb0e66da3221cac8253c1 (docker0): networks have same bridge name
INFO[2024-12-17T00:33:35.894951868+01:00] stopping event stream following graceful shutdown  error="context canceled" module=libcontainerd namespace=plugins.moby

im running a setup with a i5-12500 and 32GB of ram no dedicated GPU
All storage devices physical and virtual do not exceed 78% usage at the most

What i already tried:

  1. several restarts

  2. Unset and set the pool

  3. run this script:
    midclt call -job docker.update '{"address_pools": [{"base": "172.17.0.0/12", "size": 24}]}'

  4. delete the /etc/docker/daemom.json file (this seemed to work for a second and showed a started docker in the shell but no active apps or anything and after a restart it failed again and repeting the process does not seem to work anymore)

  5. i even reverted to an older boot enviroment thatr for sure worked and even in the older boot enviroment the docker service did not start

  6. then i tried to update the older boot enviroment and it still behaves the same

Doese anyone have an idea what i can do ?

Id rather not deal with reinstalling the apps or even TrueNas if it can be avoided.

Edit:

i tried a few steps again to see if maybe something changed ot of sheer luck and i found the following

after now again deleting daemon.json I was able to restart docker from the shell:


sudo systemctl status docker 
● docker.service - Docker Application Container Engine
     Loaded: loaded (/lib/systemd/system/docker.service; disabled; preset: disabled)
    Drop-In: /etc/systemd/system/docker.service.d
             └─override.conf
     Active: active (running) since Tue 2024-12-17 15:24:42 CET; 9s ago
TriggeredBy: ● docker.socket
       Docs:    Process: 9371 ExecStartPost=/bin/sh -c iptables -P FORWARD ACCEPT && ip6tables -P FORWARD ACCEPT (code=exited, status=0/SUCCESS)
   Main PID: 8573 (dockerd)
      Tasks: 44
     Memory: 48.7M
        CPU: 789ms
     CGroup: /system.slice/docker.service
             β”œβ”€8573 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
             β”œβ”€8817 /usr/bin/docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 32014 -container-ip 172.17.0.2 -container-port 8081
             β”œβ”€8840 /usr/bin/docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 32015 -container-ip 172.17.0.2 -container-port 32015
             └─8847 /usr/bin/docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 32016 -container-ip 172.17.0.2 -container-port 32016

Dec 17 15:24:36 truenas systemd[1]: Starting docker.service - Docker Application Container Engine...
Dec 17 15:24:36 truenas dockerd[8573]: time="2024-12-17T15:24:36.726491890+01:00" level=info msg="Starting up"
Dec 17 15:24:36 truenas dockerd[8573]: time="2024-12-17T15:24:36.762159576+01:00" level=info msg="[graphdriver] using prior storage driver: overlay2"
Dec 17 15:24:36 truenas dockerd[8573]: time="2024-12-17T15:24:36.769198251+01:00" level=info msg="Loading containers: start."
Dec 17 15:24:37 truenas dockerd[8573]: time="2024-12-17T15:24:37.989718519+01:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.16.0.0/24. Daemon option --bip can be used to set a preferred IP address"
Dec 17 15:24:38 truenas dockerd[8573]: time="2024-12-17T15:24:38.601229420+01:00" level=info msg="Loading containers: done."
Dec 17 15:24:41 truenas dockerd[8573]: time="2024-12-17T15:24:41.973447667+01:00" level=info msg="Docker daemon" commit=cc13f95 containerd-snapshotter=false storage-driver=overlay2 version=27.1.1
Dec 17 15:24:41 truenas dockerd[8573]: time="2024-12-17T15:24:41.974312083+01:00" level=info msg="Daemon has completed initialization"
Dec 17 15:24:42 truenas dockerd[8573]: time="2024-12-17T15:24:42.009006113+01:00" level=info msg="API listen on /run/docker.sock"
Dec 17 15:24:42 truenas systemd[1]: Started docker.service - Docker Application Container Engine.

but still none of my apps were visible in the gui so i tried to install a new app (calibre) and while it showed an successful install still nothing in the GUI so I checked docker in the shell and found that only calibre is running and nither plex or any other app is running

 sudo docker ps               
CONTAINER ID   IMAGE                                COMMAND   CREATED         STATUS                    PORTS                                                                          NAMES
14867f46ba61   lscr.io/linuxserver/calibre:7.22.0   "/init"   8 minutes ago   Up 17 seconds (healthy)   3000-3001/tcp, 0.0.0.0:32015-32016->32015-32016/tcp, 0.0.0.0:32014->8081/tcp   ix-calibre-calibre-1

so i attempted a restart and nothing worked anymore and i had to again delete daemon.json to even restart docker in the shell

Sounds similar to this issue: Jira

Did you make any network changes recently?

However as this one is closed as the user resolved the issue, I would recommend collecting a debug and filing a bug ticket with us.

no changes in the network as far as i know

i however tried the solution on JIRA and it did not work porpperly

i was again able to start docker via the shell but it did not show my apps from before just the one i installed after applying the β€œfix” and it didnΒ΄t keep working after unsetting and choosing my pool (i only have one and all the drives seem to work propperly)

i can get it to work only in the shell when everytime re-doing the delte and restart process in the shell

IΒ΄ll upload a bug ticket

UPDATE:

after waiting for a while i just checked docker in the shell and it was running again, but the GUI was still showing an error for app services not being able to start and docker not starting


sudo systemctl status docker                                                               
● docker.service - Docker Application Container Engine
     Loaded: loaded (/lib/systemd/system/docker.service; disabled; preset: disabled)
    Drop-In: /etc/systemd/system/docker.service.d
             └─override.conf
     Active: active (running) since Tue 2024-12-17 17:40:38 CET; 1min 49s ago
TriggeredBy: ● docker.socket
    Process: 7969 ExecStartPost=/bin/sh -c iptables -P FORWARD ACCEPT && ip6tables -P FORWARD ACCEPT (code=exited, status=0/SUCCESS)
   Main PID: 7077 (dockerd)
      Tasks: 26
     Memory: 79.6M
        CPU: 1.616s
     CGroup: /system.slice/docker.service
             └─7077 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.038263074+01:00" level=error msg="An attempt to decrement a zero mount count" active=0 id=27b0314ca74b65491ded24ea6f1418c0b842328b0796ca847d459a188a9a7785
Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.038434151+01:00" level=error msg="goroutine 483 [running]:\nruntime/debug.Stack()\n\t/usr/local/go/src/runtime/debug/stack.go:24 +0x5e\ngithub.com/docker/docker/volum>
Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.038674874+01:00" level=error msg="failed to start container" container=0644260c98ad6e0abae7627e88d54be2fedde24033b71bab923f2cad0115c622 error="network ba97ada10526bfe>
Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.038611755+01:00" level=error msg="goroutine 490 [running]:\nruntime/debug.Stack()\n\t/usr/local/go/src/runtime/debug/stack.go:24 +0x5e\ngithub.com/docker/docker/volum>
Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.038793072+01:00" level=error msg="failed to start container" container=9a615323c8083f8368d9c0a65a6d9aeda22a3e2fcd30cc465839bdb249189057 error="network 53ac1cacef23e98>
Dec 17 17:36:22 truenas dockerd[7077]: time="2024-12-17T17:36:22.039731505+01:00" level=info msg="Loading containers: done."
Dec 17 17:36:24 truenas dockerd[7077]: time="2024-12-17T17:36:24.520834871+01:00" level=info msg="Docker daemon" commit=cc13f95 containerd-snapshotter=false storage-driver=overlay2 version=27.1.1
Dec 17 17:36:24 truenas dockerd[7077]: time="2024-12-17T17:36:24.546310243+01:00" level=info msg="Daemon has completed initialization"
Dec 17 17:40:38 truenas dockerd[7077]: time="2024-12-17T17:40:38.612072797+01:00" level=info msg="API listen on /run/docker.sock"
Dec 17 17:40:38 truenas systemd[1]: Started docker.service - Docker Application Container Engine.

I also checked if the containers are running at all and none of them are no matter when installed

This is the shell output

sudo docker ps                                                                             
CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES

i did a few restarts and unset/choose rounds and while docker seems to now start reliably in the shell it still shows the same error in the GUI and the containers do not appear

1 Like

i tried a few things and found a new information IΒ΄m not sure what to do with as i do not know much about docker

sudo docker ps -a  
CONTAINER ID   IMAGE                                                                                  COMMAND                  CREATED             STATUS                         PORTS                              NAMES
11cad12f5f22   ghcr.io/advplyr/audiobookshelf:2.17.5                                                  "tini -- node index.…"   About an hour ago   Exited (143) 15 minutes ago    80/tcp, 0.0.0.0:30067->30067/tcp   ix-audiobookshelf-audiobookshelf-1
a249bd4c0e0b   python:3.13.0-slim-bookworm                                                            "python3 /script/run…"   About an hour ago   Exited (0) About an hour ago                                      ix-audiobookshelf-permissions-1
0644260c98ad   altran1502/immich-server:v1.122.2                                                      "tini -- /bin/bash s…"   8 days ago          Exited (255) 5 days ago                                           ix-immich-server-1
e1221ec2575f   altran1502/immich-machine-learning:v1.122.2                                            "tini -- ./start.sh"     8 days ago          Exited (255) 5 days ago                                           ix-immich-machine-learning-1
8c806c6d39e3   bitnami/redis:7.4.1                                                                    "/opt/bitnami/script…"   8 days ago          Exited (255) 5 days ago                                           ix-immich-redis-1
b83e25b91be5   tensorchord/pgvecto-rs:pg15-v0.2.0                                                     "docker-entrypoint.s…"   8 days ago          Exited (255) 5 days ago                                           ix-immich-pgvecto-1
f380cb65fb2c   python:3.13.0-slim-bookworm                                                            "python3 /script/run…"   8 days ago          Exited (0) 8 days ago                                             ix-immich-permissions-1
35a06b72d4fe   plexinc/pms-docker:plexpass                                                            "/init"                  10 days ago         Exited (255) 5 days ago                                           ix-plex-plex-1
aa5d044e4bb0   python:3.13.0-slim-bookworm                                                            "python3 /script/run…"   10 days ago         Exited (0) 10 days ago                                            ix-plex-permissions-1
0bed7c9899c4   nginx:1.27.3                                                                           "/docker-entrypoint.…"   10 days ago         Exited (255) 5 days ago                                           ix-nextcloud-nginx-1
9a615323c808   ix-nextcloud:30.0.2_ae80c58830818167831361b89faba440d1956adb0daee4c486a70ec1c6b3bc00   "/entrypoint.sh apac…"   10 days ago         Exited (255) 5 days ago                                           ix-nextcloud-nextcloud-1
06bff1f83d7e   postgres:13.18                                                                         "docker-entrypoint.s…"   10 days ago         Exited (255) 5 days ago                                           ix-nextcloud-postgres-1
38a941c28b3a   356e68861bb2                                                                           "/opt/bitnami/script…"   10 days ago         Exited (255) 5 days ago                                           ix-nextcloud-redis-1
ac86969a4a64   ix-postgres:13.18_3c74674a5df5d0195f28873f0c84d314e76ce74d1831908683f6046a2ca11651     "/bin/bash -c /upgra…"   10 days ago         Exited (0) 10 days ago                                            ix-nextcloud-postgres_upgrade-1
39080773c529   python:3.13.0-slim-bookworm                                                            "python3 /script/run…"   10 days ago         Exited (0) 10 days ago                                            ix-nextcloud-permissions-1
sudo docker run 0644260c98ad
Unable to find image '0644260c98ad:latest' locally
docker: Error response from daemon: pull access denied for 0644260c98ad, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.

Do i correctly understand that docker knows the containers do exist somewhere and just canΒ΄t find the directory where they are found ?

And if so how could this happen as I never touched Docker before and how could i fix it ?