SCALE 24.04.2.1 Update Slow UI and Missing Apps, Dataset etc

Ginger_Penguin · September 13, 2024, 1:33pm

Hi all. I just attempted to update to 24.04.2.1 and it didn’t seem to go right. The web UI is very slow now which seems to be an issue I’ve seen others having. My pool seems to be detected on the dashboard and in storage but in Datasets, it says I haven’t configured any pools. My shares are active and all my data is still accessible. Also all apps are gone from the list and cannot be accessed from a browser either.

Looking in the update section from the dashboard, it says ‘An update is already applied. Please reboot the system.’ I have tried multiple reboots to no avail. I have also tried both ‘Apply Pending Update’ and ‘Install Manual Update File’ and am met with the same issue regardless.

System specs:

CPU: Intel Core i5 7500
Motherboard: Asus Prime B250M-A
RAM: 16GB (4x4GB) Corsair Vengeance LPX DDR4 2133 CL15
NIC: Edimax (Realtek) 2.5Gb
Boot Drive: Gigabyte 256GB NVME SSD
Mass Storage: 5x8TB WD Blue 5640RPM WD80EAZZ

zpool status -v:

  pool: The Lost Sock
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 15:49:10 with 0 errors on Sun Aug 11 15:49:14 2024
config:

        NAME           STATE     READ WRITE CKSUM
        The Lost Sock  ONLINE       0     0     0
          raidz1-0     ONLINE       0     0     0
            sdb2       ONLINE       0     0     0
            sdd2       ONLINE       0     0     0
            sde2       ONLINE       0     0     0
            sdc2       ONLINE       0     0     0
            sda2       ONLINE       0     0     0

errors: No known data errors

  pool: boot-pool
 state: ONLINE
status: One or more features are enabled on the pool despite not being
        requested by the 'compatibility' property.
action: Consider setting 'compatibility' to an appropriate value, or
        adding needed features to the relevant file in
        /etc/zfs/compatibility.d or /usr/share/zfs/compatibility.d.
  scan: scrub repaired 0B in 00:00:32 with 0 errors on Mon Sep  9 03:45:33 2024
config:

        NAME         STATE     READ WRITE CKSUM
        boot-pool    ONLINE       0     0     0
          nvme0n1p2  ONLINE       0     0     0

errors: No known data errors

zfs list:

NAME                                                                              USED  AVAIL  REFER  MOUNTPOINT
The Lost Sock                                                                    23.7T  5.25T   179K  /mnt/The Lost Sock
The Lost Sock/.system                                                            5.67G  5.25T  1.23G  legacy
The Lost Sock/.system/configs-7bdf26d378f44463a02df9c5bc4d0ea3                   74.5M  5.25T  73.7M  legacy
The Lost Sock/.system/cores                                                      1.81M  1022M  1.21M  legacy
The Lost Sock/.system/netdata-7bdf26d378f44463a02df9c5bc4d0ea3                    405M  5.25T   283M  legacy
The Lost Sock/.system/rrd-7bdf26d378f44463a02df9c5bc4d0ea3                        227M  5.25T  55.5M  legacy
The Lost Sock/.system/samba4                                                     13.9M  5.25T   703K  legacy
The Lost Sock/.system/services                                                    153K  5.25T   153K  legacy
The Lost Sock/.system/syslog-7bdf26d378f44463a02df9c5bc4d0ea3                    11.1M  5.25T  7.55M  legacy
The Lost Sock/.system/webui                                                       153K  5.25T   153K  legacy
The Lost Sock/Archive                                                            13.6T  5.25T  1.19T  /mnt/The Lost Sock/Archive
The Lost Sock/Archive/Photos Backup                                              33.5G  5.25T  33.5G  /mnt/The Lost Sock/Archive/Photos Backup
The Lost Sock/Archive/Projects Archive                                           3.51T  5.25T  3.37T  /mnt/The Lost Sock/Archive/Projects Archive
The Lost Sock/Archive/Projects Recent                                            8.87T  5.25T  8.73T  /mnt/The Lost Sock/Archive/Projects Recent
The Lost Sock/Media                                                              10.0T  5.25T  9.90T  /mnt/The Lost Sock/Media
The Lost Sock/VM                                                                 13.1G  5.25T   153K  /mnt/The Lost Sock/VM
The Lost Sock/VM/TailscaleUB-8iff9x                                              13.1G  5.26T  89.5K  -
The Lost Sock/iocage                                                             39.4G  5.25T  10.1M  /mnt/The Lost Sock/iocage
The Lost Sock/iocage/download                                                    1.96G  5.25T   166K  /mnt/The Lost Sock/iocage/download
The Lost Sock/iocage/download/12.3-RELEASE                                        403M  5.25T   403M  /mnt/The Lost Sock/iocage/download/12.3-RELEASE
The Lost Sock/iocage/download/12.4-RELEASE                                        422M  5.25T   422M  /mnt/The Lost Sock/iocage/download/12.4-RELEASE
The Lost Sock/iocage/download/13.0-RELEASE                                        401M  5.25T   401M  /mnt/The Lost Sock/iocage/download/13.0-RELEASE
The Lost Sock/iocage/download/13.1-RELEASE                                        250M  5.25T   250M  /mnt/The Lost Sock/iocage/download/13.1-RELEASE
The Lost Sock/iocage/download/13.2-RELEASE                                        256M  5.25T   256M  /mnt/The Lost Sock/iocage/download/13.2-RELEASE
The Lost Sock/iocage/download/13.3-RELEASE                                        274M  5.25T   274M  /mnt/The Lost Sock/iocage/download/13.3-RELEASE
The Lost Sock/iocage/images                                                       243K  5.25T   153K  /mnt/The Lost Sock/iocage/images
The Lost Sock/iocage/jails                                                       30.3G  5.25T   192K  /mnt/The Lost Sock/iocage/jails
The Lost Sock/iocage/jails/adguard                                                144M  5.25T   479K  /mnt/The Lost Sock/iocage/jails/adguard
The Lost Sock/iocage/jails/adguard/root                                           143M  5.25T   119M  /mnt/The Lost Sock/iocage/jails/adguard/root
The Lost Sock/iocage/jails/clamav                                                1.35G  5.25T   447K  /mnt/The Lost Sock/iocage/jails/clamav
The Lost Sock/iocage/jails/clamav/root                                           1.35G  5.25T  1.35G  /mnt/The Lost Sock/iocage/jails/clamav/root
The Lost Sock/iocage/jails/jellyfin                                              4.68G  5.25T   179K  /mnt/The Lost Sock/iocage/jails/jellyfin
The Lost Sock/iocage/jails/jellyfin/root                                         4.68G  5.25T  3.61G  /mnt/The Lost Sock/iocage/jails/jellyfin/root
The Lost Sock/iocage/jails/nextcloud-ps                                          6.45G  5.25T   754K  /mnt/The Lost Sock/iocage/jails/nextcloud-ps
The Lost Sock/iocage/jails/nextcloud-ps/root                                     6.44G  5.25T  3.81G  /mnt/The Lost Sock/iocage/jails/nextcloud-ps/root
The Lost Sock/iocage/jails/plex                                                  14.8G  5.25T   473K  /mnt/The Lost Sock/iocage/jails/plex
The Lost Sock/iocage/jails/plex/root                                             14.8G  5.25T  6.79G  /mnt/The Lost Sock/iocage/jails/plex/root
The Lost Sock/iocage/jails/qbittorrent                                           2.34G  5.25T   473K  /mnt/The Lost Sock/iocage/jails/qbittorrent
The Lost Sock/iocage/jails/qbittorrent/root                                      2.34G  5.25T  1.65G  /mnt/The Lost Sock/iocage/jails/qbittorrent/root
The Lost Sock/iocage/jails/syncthing                                              251M  5.25T   467K  /mnt/The Lost Sock/iocage/jails/syncthing
The Lost Sock/iocage/jails/syncthing/root                                         250M  5.25T   172M  /mnt/The Lost Sock/iocage/jails/syncthing/root
The Lost Sock/iocage/jails/tailscale                                              106M  5.25T   173K  /mnt/The Lost Sock/iocage/jails/tailscale
The Lost Sock/iocage/jails/tailscale/root                                         106M  5.25T   880M  /mnt/The Lost Sock/iocage/jails/tailscale/root
The Lost Sock/iocage/jails/wireguard                                             72.6M  5.25T   160K  /mnt/The Lost Sock/iocage/jails/wireguard
The Lost Sock/iocage/jails/wireguard/root                                        72.5M  5.25T   848M  /mnt/The Lost Sock/iocage/jails/wireguard/root
The Lost Sock/iocage/jails/wol                                                   99.5M  5.25T   166K  /mnt/The Lost Sock/iocage/jails/wol
The Lost Sock/iocage/jails/wol/root                                              99.1M  5.25T  88.3M  /mnt/The Lost Sock/iocage/jails/wol/root
The Lost Sock/iocage/log                                                         1.09M  5.25T   262K  /mnt/The Lost Sock/iocage/log
The Lost Sock/iocage/releases                                                    7.11G  5.25T   166K  /mnt/The Lost Sock/iocage/releases
The Lost Sock/iocage/releases/12.3-RELEASE                                       1.63G  5.25T   153K  /mnt/The Lost Sock/iocage/releases/12.3-RELEASE
The Lost Sock/iocage/releases/12.3-RELEASE/root                                  1.63G  5.25T  1.63G  /mnt/The Lost Sock/iocage/releases/12.3-RELEASE/root
The Lost Sock/iocage/releases/12.4-RELEASE                                       1.67G  5.25T   153K  /mnt/The Lost Sock/iocage/releases/12.4-RELEASE
The Lost Sock/iocage/releases/12.4-RELEASE/root                                  1.67G  5.25T  1.67G  /mnt/The Lost Sock/iocage/releases/12.4-RELEASE/root
The Lost Sock/iocage/releases/13.0-RELEASE                                       1.63G  5.25T   153K  /mnt/The Lost Sock/iocage/releases/13.0-RELEASE
The Lost Sock/iocage/releases/13.0-RELEASE/root                                  1.63G  5.25T  1.62G  /mnt/The Lost Sock/iocage/releases/13.0-RELEASE/root
The Lost Sock/iocage/releases/13.1-RELEASE                                        718M  5.25T   153K  /mnt/The Lost Sock/iocage/releases/13.1-RELEASE
The Lost Sock/iocage/releases/13.1-RELEASE/root                                   718M  5.25T   711M  /mnt/The Lost Sock/iocage/releases/13.1-RELEASE/root
The Lost Sock/iocage/releases/13.2-RELEASE                                        738M  5.25T   153K  /mnt/The Lost Sock/iocage/releases/13.2-RELEASE
The Lost Sock/iocage/releases/13.2-RELEASE/root                                   738M  5.25T   732M  /mnt/The Lost Sock/iocage/releases/13.2-RELEASE/root
The Lost Sock/iocage/releases/13.3-RELEASE                                        777M  5.25T   153K  /mnt/The Lost Sock/iocage/releases/13.3-RELEASE
The Lost Sock/iocage/releases/13.3-RELEASE/root                                   777M  5.25T   777M  /mnt/The Lost Sock/iocage/releases/13.3-RELEASE/root
The Lost Sock/iocage/templates                                                    243K  5.25T   153K  /mnt/The Lost Sock/iocage/templates
The Lost Sock/ix-applications                                                    13.6G  5.25T   882K  /mnt/The Lost Sock/ix-applications
The Lost Sock/ix-applications/catalogs                                            135M  5.25T  65.7M  /mnt/The Lost Sock/ix-applications/catalogs
The Lost Sock/ix-applications/default_volumes                                     153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/default_volumes
The Lost Sock/ix-applications/k3s                                                8.38G  5.25T  8.29G  /mnt/The Lost Sock/ix-applications/k3s
The Lost Sock/ix-applications/k3s/kubelet                                        3.30M  5.25T  2.06M  legacy
The Lost Sock/ix-applications/releases                                           5.11G  5.25T   204K  /mnt/The Lost Sock/ix-applications/releases
The Lost Sock/ix-applications/releases/flaresolverr                               767K  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/flaresolverr
The Lost Sock/ix-applications/releases/flaresolverr/charts                        294K  5.25T   294K  /mnt/The Lost Sock/ix-applications/releases/flaresolverr/charts
The Lost Sock/ix-applications/releases/flaresolverr/volumes                       307K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/flaresolverr/volumes
The Lost Sock/ix-applications/releases/flaresolverr/volumes/ix_volumes            153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/flaresolverr/volumes/ix_volumes
The Lost Sock/ix-applications/releases/homepage                                  1.03M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/homepage
The Lost Sock/ix-applications/releases/homepage/charts                            351K  5.25T   351K  /mnt/The Lost Sock/ix-applications/releases/homepage/charts
The Lost Sock/ix-applications/releases/homepage/volumes                           550K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/homepage/volumes
The Lost Sock/ix-applications/releases/homepage/volumes/ix_volumes                396K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/homepage/volumes/ix_volumes
The Lost Sock/ix-applications/releases/homepage/volumes/ix_volumes/config         243K  5.25T   243K  /mnt/The Lost Sock/ix-applications/releases/homepage/volumes/ix_volumes/config
The Lost Sock/ix-applications/releases/jellyfin                                  4.56G  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/jellyfin
The Lost Sock/ix-applications/releases/jellyfin/charts                            511K  5.25T   511K  /mnt/The Lost Sock/ix-applications/releases/jellyfin/charts
The Lost Sock/ix-applications/releases/jellyfin/volumes                          4.56G  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/jellyfin/volumes
The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes               4.56G  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes
The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/cache         1.32G  5.25T  1.06G  /mnt/The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/cache
The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/config        3.24G  5.25T  3.01G  /mnt/The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/config
The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/transcodes     153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/jellyfin/volumes/ix_volumes/transcodes
The Lost Sock/ix-applications/releases/nextcloud                                  523M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/nextcloud
The Lost Sock/ix-applications/releases/nextcloud/charts                           486K  5.25T   486K  /mnt/The Lost Sock/ix-applications/releases/nextcloud/charts
The Lost Sock/ix-applications/releases/nextcloud/volumes                          523M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/nextcloud/volumes
The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes               522M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes
The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/html          470M  5.25T   470M  /mnt/The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/html
The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/pgBackup      153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/pgBackup
The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/pgData       52.1M  5.25T  32.0M  /mnt/The Lost Sock/ix-applications/releases/nextcloud/volumes/ix_volumes/pgData
The Lost Sock/ix-applications/releases/photoprism                                 856K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/photoprism
The Lost Sock/ix-applications/releases/photoprism/charts                          396K  5.25T   396K  /mnt/The Lost Sock/ix-applications/releases/photoprism/charts
The Lost Sock/ix-applications/releases/photoprism/volumes                         307K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/photoprism/volumes
The Lost Sock/ix-applications/releases/photoprism/volumes/ix_volumes              153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/photoprism/volumes/ix_volumes
The Lost Sock/ix-applications/releases/prowlarr                                  21.0M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/prowlarr
The Lost Sock/ix-applications/releases/prowlarr/charts                            339K  5.25T   339K  /mnt/The Lost Sock/ix-applications/releases/prowlarr/charts
The Lost Sock/ix-applications/releases/prowlarr/volumes                          20.5M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/prowlarr/volumes
The Lost Sock/ix-applications/releases/prowlarr/volumes/ix_volumes               20.4M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/prowlarr/volumes/ix_volumes
The Lost Sock/ix-applications/releases/prowlarr/volumes/ix_volumes/config        20.2M  5.25T  15.5M  /mnt/The Lost Sock/ix-applications/releases/prowlarr/volumes/ix_volumes/config
The Lost Sock/ix-applications/releases/qbittorrent                               8.87M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/qbittorrent
The Lost Sock/ix-applications/releases/qbittorrent/charts                         339K  5.25T   339K  /mnt/The Lost Sock/ix-applications/releases/qbittorrent/charts
The Lost Sock/ix-applications/releases/qbittorrent/volumes                       8.38M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/qbittorrent/volumes
The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes            8.23M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes
The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes/config     7.91M  5.25T  7.40M  /mnt/The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes/config
The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes/downloads   153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/qbittorrent/volumes/ix_volumes/downloads
The Lost Sock/ix-applications/releases/sonarr                                    9.82M  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/sonarr
The Lost Sock/ix-applications/releases/sonarr/charts                              339K  5.25T   339K  /mnt/The Lost Sock/ix-applications/releases/sonarr/charts
The Lost Sock/ix-applications/releases/sonarr/volumes                            9.32M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/sonarr/volumes
The Lost Sock/ix-applications/releases/sonarr/volumes/ix_volumes                 9.17M  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/sonarr/volumes/ix_volumes
The Lost Sock/ix-applications/releases/sonarr/volumes/ix_volumes/config          9.02M  5.25T  8.86M  /mnt/The Lost Sock/ix-applications/releases/sonarr/volumes/ix_volumes/config
The Lost Sock/ix-applications/releases/tailscale                                  824K  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/tailscale
The Lost Sock/ix-applications/releases/tailscale/charts                           351K  5.25T   351K  /mnt/The Lost Sock/ix-applications/releases/tailscale/charts
The Lost Sock/ix-applications/releases/tailscale/volumes                          307K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/tailscale/volumes
The Lost Sock/ix-applications/releases/tailscale/volumes/ix_volumes               153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/tailscale/volumes/ix_volumes
The Lost Sock/ix-applications/releases/upsnap                                     920K  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/upsnap
The Lost Sock/ix-applications/releases/upsnap/charts                              294K  5.25T   294K  /mnt/The Lost Sock/ix-applications/releases/upsnap/charts
The Lost Sock/ix-applications/releases/upsnap/volumes                             460K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/upsnap/volumes
The Lost Sock/ix-applications/releases/upsnap/volumes/ix_volumes                  307K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/upsnap/volumes/ix_volumes
The Lost Sock/ix-applications/releases/upsnap/volumes/ix_volumes/pb_data          153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/upsnap/volumes/ix_volumes/pb_data
The Lost Sock/ix-applications/releases/wolweb                                     767K  5.25T   166K  /mnt/The Lost Sock/ix-applications/releases/wolweb
The Lost Sock/ix-applications/releases/wolweb/charts                              294K  5.25T   294K  /mnt/The Lost Sock/ix-applications/releases/wolweb/charts
The Lost Sock/ix-applications/releases/wolweb/volumes                             307K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/wolweb/volumes
The Lost Sock/ix-applications/releases/wolweb/volumes/ix_volumes                  153K  5.25T   153K  /mnt/The Lost Sock/ix-applications/releases/wolweb/volumes/ix_volumes
boot-pool                                                                        17.5G   198G    24K  none
boot-pool/ROOT                                                                   17.5G   198G    24K  none
boot-pool/ROOT/12.0-U4                                                            195K   198G  1.18G  /
boot-pool/ROOT/12.0-U8.1                                                          182K   198G  1.20G  /
boot-pool/ROOT/13.0-U1                                                            195K   198G  1.29G  /
boot-pool/ROOT/13.0-U5.3                                                          192K   198G  1.29G  /
boot-pool/ROOT/13.0-U6.1                                                          192K   198G  1.29G  /
boot-pool/ROOT/13.0-U6.2                                                         8.70G   198G  1.29G  /
boot-pool/ROOT/24.04.2                                                           2.36G   198G   164M  legacy
boot-pool/ROOT/24.04.2.1                                                         2.14G   198G   164M  legacy
boot-pool/ROOT/24.04.2.1-1                                                       2.14G   198G   164M  legacy
boot-pool/ROOT/24.04.2.1-1/audit                                                   24K   198G    24K  /audit
boot-pool/ROOT/24.04.2.1-1/conf                                                  41.5K   198G  41.5K  /conf
boot-pool/ROOT/24.04.2.1-1/data                                                  63.5K   198G  7.73M  /data
boot-pool/ROOT/24.04.2.1-1/etc                                                   3.02M   198G  3.02M  /etc
boot-pool/ROOT/24.04.2.1-1/home                                                    15K   198G    27K  /home
boot-pool/ROOT/24.04.2.1-1/mnt                                                     24K   198G    24K  /mnt
boot-pool/ROOT/24.04.2.1-1/opt                                                   72.0M   198G  72.0M  /opt
boot-pool/ROOT/24.04.2.1-1/root                                                    23K   198G   134K  /root
boot-pool/ROOT/24.04.2.1-1/usr                                                   1.89G   198G  1.89G  /usr
boot-pool/ROOT/24.04.2.1-1/var                                                   18.8M   198G  18.8M  /var
boot-pool/ROOT/24.04.2.1-1/var/ca-certificates                                     24K   198G    24K  /var/local/ca-certificates
boot-pool/ROOT/24.04.2.1-1/var/log                                                 39K   198G  61.6M  /var/log
boot-pool/ROOT/24.04.2.1-2                                                       2.14G   198G   164M  legacy
boot-pool/ROOT/24.04.2.1-2/audit                                                   24K   198G    24K  /audit
boot-pool/ROOT/24.04.2.1-2/conf                                                  41.5K   198G  41.5K  /conf
boot-pool/ROOT/24.04.2.1-2/data                                                  63.5K   198G  7.73M  /data
boot-pool/ROOT/24.04.2.1-2/etc                                                   3.02M   198G  3.02M  /etc
boot-pool/ROOT/24.04.2.1-2/home                                                    15K   198G    27K  /home
boot-pool/ROOT/24.04.2.1-2/mnt                                                     24K   198G    24K  /mnt
boot-pool/ROOT/24.04.2.1-2/opt                                                   72.0M   198G  72.0M  /opt
boot-pool/ROOT/24.04.2.1-2/root                                                    23K   198G   134K  /root
boot-pool/ROOT/24.04.2.1-2/usr                                                   1.89G   198G  1.89G  /usr
boot-pool/ROOT/24.04.2.1-2/var                                                   18.8M   198G  18.8M  /var
boot-pool/ROOT/24.04.2.1-2/var/ca-certificates                                     24K   198G    24K  /var/local/ca-certificates
boot-pool/ROOT/24.04.2.1-2/var/log                                                 39K   198G  61.7M  /var/log
boot-pool/ROOT/24.04.2.1/audit                                                     24K   198G    24K  /audit
boot-pool/ROOT/24.04.2.1/conf                                                    42.5K   198G  42.5K  /conf
boot-pool/ROOT/24.04.2.1/data                                                    63.5K   198G  7.73M  /data
boot-pool/ROOT/24.04.2.1/etc                                                     3.02M   198G  3.02M  /etc
boot-pool/ROOT/24.04.2.1/home                                                      15K   198G    27K  /home
boot-pool/ROOT/24.04.2.1/mnt                                                       24K   198G    24K  /mnt
boot-pool/ROOT/24.04.2.1/opt                                                     72.0M   198G  72.0M  /opt
boot-pool/ROOT/24.04.2.1/root                                                      23K   198G   134K  /root
boot-pool/ROOT/24.04.2.1/usr                                                     1.89G   198G  1.89G  /usr
boot-pool/ROOT/24.04.2.1/var                                                     18.8M   198G  18.8M  /var
boot-pool/ROOT/24.04.2.1/var/ca-certificates                                       24K   198G    24K  /var/local/ca-certificates
boot-pool/ROOT/24.04.2.1/var/log                                                   40K   198G  67.8M  /var/log
boot-pool/ROOT/24.04.2/audit                                                      384K   198G   384K  /audit
boot-pool/ROOT/24.04.2/conf                                                      42.5K   198G  42.5K  /conf
boot-pool/ROOT/24.04.2/data                                                      7.81M   198G  7.73M  /data
boot-pool/ROOT/24.04.2/etc                                                       4.75M   198G  4.24M  /etc
boot-pool/ROOT/24.04.2/home                                                        27K   198G    27K  /home
boot-pool/ROOT/24.04.2/mnt                                                         24K   198G    24K  /mnt
boot-pool/ROOT/24.04.2/opt                                                       72.0M   198G  72.0M  /opt
boot-pool/ROOT/24.04.2/root                                                       177K   198G   136K  /root
boot-pool/ROOT/24.04.2/usr                                                       1.89G   198G  1.89G  /usr
boot-pool/ROOT/24.04.2/var                                                       90.1M   198G  19.6M  /var
boot-pool/ROOT/24.04.2/var/ca-certificates                                         24K   198G    24K  /var/local/ca-certificates
boot-pool/ROOT/24.04.2/var/log                                                   70.1M   198G  61.8M  /var/log
boot-pool/ROOT/Initial-Install                                                      1K   198G  1.16G  legacy
boot-pool/ROOT/default                                                            176K   198G  1.16G  legacy
boot-pool/grub                                                                   1.91M   198G  1.91M  legacy

It seems the best thing to do would be a fresh install but I’m concerned about losing my data in the process. I presume I just need to export the pool and hopefully the datasets will come with but I’m getting the following error when selecting that option:

# Error exporting/disconnecting pool.

[err -110]: b"Failed to activate service 'org.freedesktop.systemd1': timed out (service_start_timeout=25000ms)"

Error: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 198, in call_method
    result = await self.middleware.call_with_audit(message['method'], serviceobj, methodobj, params, self)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1466, in call_with_audit
    result = await self._call(method, serviceobj, methodobj, params, app=app,
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 187, in nf
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 47, in nf
    res = await f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/pool_/info.py", line 55, in attachments
    return await self.middleware.call('pool.dataset.attachments_with_path', pool['path'])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/pool_/dataset_attachments.py", line 48, in attachments_with_path
    for attachment in await delegate.query(path, True, options):
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/attachments.py", line 83, in query
    ignored_vms = await self.middleware.call('vm.get_vms_to_ignore_for_querying_attachments', enabled)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/attachments.py", line 71, in get_vms_to_ignore_for_querying_attachments
    vm['id']: vm for vm in await self.middleware.call(
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 47, in nf
    res = await f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 187, in nf
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/service/crud_service.py", line 166, in query
    result = await self.middleware.call(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 187, in nf
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/datastore/read.py", line 149, in query
    result = await self._queryset_serialize(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/datastore/read.py", line 197, in _queryset_serialize
    extend_context_value = await self.middleware.call(extend_context, rows, extra_options)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1428, in _call
    return await self.run_in_executor(prepared_call.executor, methodobj, *prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1321, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vms.py", line 103, in extend_context
    self._check_setup_connection()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/connection.py", line 70, in _check_setup_connection
    self.middleware.call_sync('vm.setup_libvirt_connection', 10)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1600, in call_sync
    return methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 37, in setup_libvirt_connection
    self.middleware.call_sync('vm.wait_for_libvirtd', timeout)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1589, in call_sync
    return self.run_coroutine(methodobj(*prepared_call.args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1629, in run_coroutine
    return fut.result()
           ^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 26, in wait_for_libvirtd
    if not await self.middleware.call('service.started', 'libvirtd'):
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1564, in call
    return await self._call(
           ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1417, in _call
    return await methodobj(*prepared_call.args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 187, in nf
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/schema/processor.py", line 47, in nf
    res = await f(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 215, in started
    state = await service_object.get_state()
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 38, in get_state
    return await self.middleware.run_in_thread(self._get_state_sync)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1324, in run_in_thread
    return await self.run_in_executor(self.thread_pool_executor, method, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1321, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 41, in _get_state_sync
    unit = self._get_systemd_unit()
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 77, in _get_systemd_unit
    unit.load()
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 90, in load
    unit_xml = self.get_introspect_xml()
               ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 75, in get_introspect_xml
    bus.call_method(
  File "pystemd/dbuslib.pyx", line 446, in pystemd.dbuslib.DBus.call_method
pystemd.dbusexc.DBusTimedOutError: [err -110]: b"Failed to activate service 'org.freedesktop.systemd1': timed out (service_start_timeout=25000ms)"

If I close that dialog box, I still have access to the Export/Disconnect options but I’ve not been game to go any further just at the moment. Any suggestions?

neofusion · September 13, 2024, 1:41pm

Please read the pinned post at the top of the forum:

Without additional details about your setup, hardware and software, it will be all but impossible to assist you in more than the most generic of ways.

Ginger_Penguin · September 13, 2024, 2:01pm

I have updated the main post to include a lot more info.

neofusion · September 13, 2024, 2:16pm

Was this an update from 24.04.2 → 24.04.2.1 or something else?

This makes me think your boot-pool is having issues, even if no ZFS errors have been reported.

Save a copy of your TrueNAS configuration file before you do anything else, if you don’t have a current one already.

Do you run regular long SMART tests? I recommend you run a long test on your boot-pool and report back when the results are in.

Ginger_Penguin · September 13, 2024, 2:47pm

I’m not 100% sure as I’ve been away for about 5 weeks and haven’t been monitoring the server all that much aside from just using its services remotely. It would either have been 24.04.2 or 24.04.1 though.

Apparently my boot SSD doesn’t support SMART Tests according to the Truenas UI. I tried to run ‘smartctl -t long /dev/nvme0n1’ but got this error:

Read Self-test Log failed: Invalid Namespace or Format (0x200b)

Here’s the full output of smart-ctl -x /dev/nvme0n1:

smartctl -x /dev/nvme0n1
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.6.32-production+truenas] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       GIGABYTE GP-GSM2NE3256GNTD
Serial Number:                      SN194108903277
Firmware Version:                   EDFM00.2
PCI Vendor/Subsystem ID:            0x1987
IEEE OUI Identifier:                0x6479a7
Total NVM Capacity:                 256,060,514,304 [256 GB]
Unallocated NVM Capacity:           0
Controller ID:                      0
NVMe Version:                       1.3
Number of Namespaces:               1
Namespace 1 Size/Capacity:          256,060,514,304 [256 GB]
Namespace 1 Formatted LBA Size:     512
Local Time is:                      Sat Sep 14 00:36:21 2024 AEST
Firmware Updates (0x12):            1 Slot, no Reset required
Optional Admin Commands (0x001f):   Security Format Frmw_DL NS_Mngmt Self_Test
Optional NVM Commands (0x005e):     Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp
Log Page Attributes (0x0e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg
Maximum Data Transfer Size:         64 Pages
Warning  Comp. Temp. Threshold:     68 Celsius
Critical Comp. Temp. Threshold:     70 Celsius

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     7.90W  0.0790W       -    0  0  0  0      600     600
 1 +     7.90W  0.0790W       -    1  1  1  1      600     600
 2 +     7.90W  0.0790W       -    2  2  2  2      600     600
 3 -   0.1000W  0.0790W       -    3  3  3  3     1000    1000
 4 -   0.0050W  0.0790W       -    4  4  4  4     5000  100000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         1

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        26 Celsius
Available Spare:                    100%
Available Spare Threshold:          5%
Percentage Used:                    0%
Data Units Read:                    2,906,359 [1.48 TB]
Data Units Written:                 3,031,510 [1.55 TB]
Host Read Commands:                 33,783,301
Host Write Commands:                108,745,833
Controller Busy Time:               1,894
Power Cycles:                       1,041
Power On Hours:                     32,757
Unsafe Shutdowns:                   73
Media and Data Integrity Errors:    0
Error Information Log Entries:      3,713
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0

Error Information (NVMe Log 0x01, 16 of 16 entries)
Num   ErrCount  SQId   CmdId  Status  PELoc          LBA  NSID    VS  Message
  0       3713     0  0x9014  0x4016  0x004            0     1     -  Invalid Namespace or Format

Read Self-test Log failed: Invalid Namespace or Format (0x200b)

neofusion · September 13, 2024, 3:07pm

Thank you.
I missed that the boot drive was an NVMe, those SMART reports are less detailed.

There are 3713 error information log entries, that log is often diluted by essentially benign entries so on it’s own it’s not enough to conclude the drive is inherently broken. More importantly the Media and Data Integrity Error entry is zero.

Still, the boot-pool is still a logical suspect. Do you have a different drive you could try?
Be careful if you reinstall TrueNAS, it’s easy to accidentally wipe the wrong drive during install if you’re not paying attention.

Ginger_Penguin · September 13, 2024, 3:20pm

I do have a SATA SSD lying around from an old build I could probably use. It’s getting late here though so that’s probably a tomorrow job unfortunately. I’ll just have to have my services down overnight. Do I have the process right that I should need to make a fresh install on the test drive and import the config file? Or do I also need to export/disconnect the pool as well?

neofusion · September 13, 2024, 3:26pm

Yes, that should work. I would physically remove the NVMe to make sure it doesn’t interfere with the boot process.

No, this is not required.
The pools are exported and imported every reboot anyway.

Ginger_Penguin · September 13, 2024, 4:47pm

I haven’t yet tried the new SSD but I noticed when I went to shut it down that it wouldn’t actually shut down. I’m not sure if it even rebooted any of the times that I tried to make it reboot previously. I pulled the power and restarted. It’s now showing the correct version number, everything is visible and accessible. I will make a copy of my config now just in case it happens again and I do have to do a fresh install but for now it seems okay.

neofusion · September 13, 2024, 5:58pm

Lucky, if it can restart successfully now.

Definitely this, always have a current config file saved somewhere else.
This is especially important if the pools are encrypted (not sure if that’s the case here).

Ginger_Penguin · October 3, 2024, 12:21am

So everything’s been fine and I’ve been able to reboot as normal. I tried to update to 24.10 RC this morning however and it wouldn’t fully reboot. I plugged in a display cable and the below is the screen I’ve got. I’m obviously wary of doing a full hard reset during an update so I was wondering if I’m safe to do so?