After updateing to ElectricEel-24.10.2.2 from 24.10.2.1 All datasets shared with samba are empty

System:
AMD 5600X
64GB ECC memory
Intel Arc 380
RaidZ1 3X 18TB main storage
Mirrored 2x 512GB app drive

After update to ElectricEel-24.10.2.2 from 24.10.2.1 All datasets shared with samba are empty. The drives usage reports disk usage of what I would expect for that data in the UI storage tab but Smaba on windows and SFTP report the folders empty. Folders that are stet up in the datasets are present but their contents that used to be present before the update is now empty.

I have tried reverting to my previous saved config on the last, 10.2.1 boot environment, but my data is still missing.

I am missing ruffly 14TB of personal data after updating to 10.2.2, I am at a loss on things to diagnose or try. Any help would be appreciated.

So that we’re certain:

zfs list -t filesystem,vol -r -o space <poolname>

This could be a permissions issue or something wrong on your Windows client.

See if the files are visible using the command-line in the Shell or an SSH session. Use ls in one of the directories.

The above command lists the samba stores as empty, same as the datasets UI
Jellyfin_Data
Syncthing_Data
Vault
Were all my samba shares

root@truenas[~]# zfs list -t filesystem,vol -r -o space ZFSStor
NAME                                                      AVAIL   USED  USEDSNAP  USEDDS  USEDREFRESERV  USEDCHILD
ZFSStor                                                   18.0T  14.6T      281G   14.1T             0B       173G
ZFSStor/.system                                           18.0T  3.86G     4.04M   1.48G             0B      2.38G
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f  18.0T   117M      501K    116M             0B         0B
ZFSStor/.system/cores                                     1020M  4.10M     3.94M    160K             0B         0B
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f  18.0T  2.26G     1.71G    565M             0B         0B
ZFSStor/.system/nfs                                       18.0T   533K      384K    149K             0B         0B
ZFSStor/.system/samba4                                    18.0T  1.71M     1.16M    565K             0B         0B
ZFSStor/Frigate                                           18.0T  2.34G     85.2K    139K             0B      2.34G
ZFSStor/Frigate/Config                                    18.0T  27.9M     9.06M   18.9M             0B         0B
ZFSStor/Frigate/Media_Storage                             18.0T  2.31G     1.26G   1.05G             0B         0B
ZFSStor/Handbrake_Dataset                                 18.0T   384K        0B    128K             0B       256K
ZFSStor/Handbrake_Dataset/Config                          18.0T   128K        0B    128K             0B         0B
ZFSStor/Handbrake_Dataset/download_storage                18.0T   128K        0B    128K             0B         0B
ZFSStor/HomeAssistant_Dataset                             18.0T   719K        0B    139K             0B       581K
ZFSStor/HomeAssistant_Dataset/Config                      18.0T   453K     85.2K    368K             0B         0B
ZFSStor/HomeAssistant_Dataset/Media_Storage               18.0T   128K        0B    128K             0B         0B
ZFSStor/ImageMirror_Backups                               18.0T   224K     85.2K    139K             0B         0B
ZFSStor/Jellyfin_Data                                     18.0T   778K        0B    139K             0B       639K
ZFSStor/Jellyfin_Data/Config                              18.0T   128K        0B    128K             0B         0B
ZFSStor/Jellyfin_Data/Content                             18.0T   128K        0B    128K             0B         0B
ZFSStor/Jellyfin_Data/Customization                       18.0T   128K        0B    128K             0B         0B
ZFSStor/Jellyfin_Data/SourceCollection                    18.0T   128K        0B    128K             0B         0B
ZFSStor/Jellyfin_Data/TranscodeData                       18.0T   128K        0B    128K             0B         0B
ZFSStor/NextCloud_Data                                    18.0T   167G     95.9K    160K             0B       167G
ZFSStor/NextCloud_Data/AppData                            18.0T   167G        0B    167G             0B         0B
ZFSStor/NextCloud_Data/Postgres_Data                      18.0T   128K        0B    128K             0B         0B
ZFSStor/NextCloud_Data/UserData_Storage                   18.0T   128K        0B    128K             0B         0B
ZFSStor/Syncthing_Data                                    18.0T   128K        0B    128K             0B         0B
ZFSStor/Vault                                             18.0T   128K        0B    128K             0B         0B

This is why.

You’re storing files directly inside the root dataset. You should never do this. This must have been from an older version of TrueNAS, before they had locked the root dataset permissions from being modified.

What you’re seeing are folders that share the same name as datasets. However, the folders that you saved your data inside are being overlaid by empty datasets that have the same names. That’s why the path is empty when you try to browse it.

You need to safely move everything into their respective datasets. This requires you to temporarily rename your datasets so that they don’t overlay the existing folders. Do the move operation. Safely delete the now empty folders. Finally, rename your datasets back to their original names.

I would stop any SMB or NFS service and stop any Apps while you do this, and make sure no clients are using the server.

1 Like

Thank you for helping me with this… I am a bit confused by what you mean by the “root dataset” when using ssh or ftp to look at the server under the mnt directory there are none of the reported ~14Tb files. Is there somewhere else I should be looking for my missing files?

This must have been from an older version of TrueNAS, before they had locked the root dataset permissions from being modified

I had created these datasets from the UI about 2 months ago on 24.10.2.1 migrating from a different set of drives. I created the datasets through the UI but I migrated the data to them from older drives over ftp

I apologize for not having good background knowledge on issues like this but truly appriciate the help!

With the Shell or SSH, what is the result of these commands?

ls -l /mnt/ZFSStor

du -hs --apparent-size /mnt/ZFSStor/*

zfs mount | grep ZFSStor

zfs list -t filesystem -o name,mountpoint -d1 ZFSStor

Here they are:

ls -l /mnt/ZFSStor

total 82
drwxr-xr-x  4 root     root     13 Sep 13  2024 ESPHome_Data
drwxrwx---  5 root     root      5 Jun 13 07:17 Frigate
drwxrwx---  4 root     root      4 Apr 29 19:21 Handbrake_Dataset
drwxrwx---  4 root     root      4 Apr 29 19:49 HomeAssistant_Dataset
drwxr-xr-x  4 root     root      4 Mar 29  2024 ImageMirror_Backups
drwxrwx---  7 root     root      7 Apr 29 19:21 Jellyfin_Data
drwxrwxr-x  7 apps     apps      9 Nov  1  2024 NGINX_Data
drwxr-xr-x  7 apps     apps      9 Jun 14  2024 NGINX_Scale_Data
drwxrwx---  7 root     root      7 Jun 13 07:17 NextCloud_Data
drwxrwx--- 17 www-data www-data 38 Apr 18 21:50 NextCloud_True
drwx------ 19 netdata  docker   25 Apr 18 21:53 Postgres_data
drwxrwx---  3 root     root      3 Apr 29 19:53 Syncthing_Data
drwxrwxr-x  4 apps     apps      4 Mar 10  2024 Valheim
drwxrwx---  2 root     root      2 Apr 29 20:26 Vault
drwxr-xr-x  4 root     root      4 Nov  1  2024 Vaultwarden
drwxr-xr-x  3 root     root      3 Dec 15  2023 ffmpeg-config
drwxr-xr-x  2 root     root      3 Dec 15  2023 ffmpeg-dtsac3

du -hs --apparent-size /mnt/ZFSStor/*

599M    /mnt/ZFSStor/ESPHome_Data
1.2G    /mnt/ZFSStor/Frigate
8       /mnt/ZFSStor/Handbrake_Dataset
199K    /mnt/ZFSStor/HomeAssistant_Dataset
8       /mnt/ZFSStor/ImageMirror_Backups
17      /mnt/ZFSStor/Jellyfin_Data
7.8M    /mnt/ZFSStor/NGINX_Data
141K    /mnt/ZFSStor/NGINX_Scale_Data
167G    /mnt/ZFSStor/NextCloud_Data
779M    /mnt/ZFSStor/NextCloud_True
55M     /mnt/ZFSStor/Postgres_data
5       /mnt/ZFSStor/Syncthing_Data
15G     /mnt/ZFSStor/Valheim
2       /mnt/ZFSStor/Vault
46M     /mnt/ZFSStor/Vaultwarden
116     /mnt/ZFSStor/ffmpeg-config
1.2K    /mnt/ZFSStor/ffmpeg-dtsac3

zfs mount | grep ZFSStor

ZFSStor                         /mnt/ZFSStor
ZFSStor/Frigate                 /mnt/ZFSStor/Frigate
ZFSStor/Syncthing_Data          /mnt/ZFSStor/Syncthing_Data
ZFSStor/Frigate/Media_Storage   /mnt/ZFSStor/Frigate/Media_Storage
ZFSStor/Handbrake_Dataset       /mnt/ZFSStor/Handbrake_Dataset
ZFSStor/Jellyfin_Data           /mnt/ZFSStor/Jellyfin_Data
ZFSStor/HomeAssistant_Dataset   /mnt/ZFSStor/HomeAssistant_Dataset
ZFSStor/ImageMirror_Backups     /mnt/ZFSStor/ImageMirror_Backups
ZFSStor/HomeAssistant_Dataset/Config  /mnt/ZFSStor/HomeAssistant_Dataset/Config
ZFSStor/Jellyfin_Data/SourceCollection  /mnt/ZFSStor/Jellyfin_Data/SourceCollection
ZFSStor/Jellyfin_Data/TranscodeData  /mnt/ZFSStor/Jellyfin_Data/TranscodeData
ZFSStor/Handbrake_Dataset/download_storage  /mnt/ZFSStor/Handbrake_Dataset/download_storage
ZFSStor/NextCloud_Data          /mnt/ZFSStor/NextCloud_Data
ZFSStor/Frigate/Config          /mnt/ZFSStor/Frigate/Config
ZFSStor/Vault                   /mnt/ZFSStor/Vault
ZFSStor/Jellyfin_Data/Customization  /mnt/ZFSStor/Jellyfin_Data/Customization
ZFSStor/Jellyfin_Data/Content   /mnt/ZFSStor/Jellyfin_Data/Content
ZFSStor/Handbrake_Dataset/Config  /mnt/ZFSStor/Handbrake_Dataset/Config
ZFSStor/Jellyfin_Data/Config    /mnt/ZFSStor/Jellyfin_Data/Config
ZFSStor/HomeAssistant_Dataset/Media_Storage  /mnt/ZFSStor/HomeAssistant_Dataset/Media_Storage
ZFSStor/NextCloud_Data/AppData  /mnt/ZFSStor/NextCloud_Data/AppData
ZFSStor/NextCloud_Data/Postgres_Data  /mnt/ZFSStor/NextCloud_Data/Postgres_Data
ZFSStor/NextCloud_Data/UserData_Storage  /mnt/ZFSStor/NextCloud_Data/UserData_Storage
ZFSStor/.system                 /var/db/system
ZFSStor/.system/cores           /var/db/system/cores
ZFSStor/.system/nfs             /var/db/system/nfs
ZFSStor/.system/samba4          /var/db/system/samba4
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f  /var/db/system/configs-a79f32b3a852420ca0f9433c4fd6884f
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f  /var/db/system/netdata
ZFSStor/.system/cores           /var/lib/systemd/coredump

zfs list -t filesystem -o name -d1 ZFSStor

NAME
ZFSStor
ZFSStor/.system
ZFSStor/Frigate
ZFSStor/Handbrake_Dataset
ZFSStor/HomeAssistant_Dataset
ZFSStor/ImageMirror_Backups
ZFSStor/Jellyfin_Data
ZFSStor/NextCloud_Data
ZFSStor/Syncthing_Data
ZFSStor/Vault

This is going to require some manual intervention, which could interfere with currently running apps and services, and it will probably confuse the middleware. :frowning_face:

Are you willing to stop all services (except SSH), all shares, and make sure no one is connected to the NAS? You can’t safely continue otherwise.

For sure. Everything is down now. All apps and samba.

Are you using SSH or the “Shell” in the GUI for these commands?

I have the putty application connected via ssh

1 Like

Close any pages that have the TrueNAS GUI open.


Before anything, create a checkpoint for your pool:

zpool checkpoint ZFSStor

zpool status | grep checkpoint

Check if your pool supports block-cloning.

zpool get  feature@block_cloning

Thank you for holding my hand through this.

checkpoint: created Fri Jun 13 11:37:29 2025, consumes 1008K
zpool get  feature@block_cloning
NAME          PROPERTY               VALUE                  SOURCE
ZFSStor       feature@block_cloning  active                 local
boot-pool     feature@block_cloning  active                 local
image mirror  feature@block_cloning  active                 local

Are you using any encrypted datasets?

No. All are unencrypted.

1 Like

Here’s where the server or middleware might freak out.

Unmount these datasets one by one in this order.

Don’t rush this part.

zfs umount ZFSStor/Frigate/Media_Storage
zfs umount ZFSStor/Frigate/Config
zfs umount ZFSStor/Frigate

zfs umount ZFSStor/Syncthing_Data

zfs umount ZFSStor/Handbrake_Dataset/download_storage
zfs umount ZFSStor/Handbrake_Dataset/Config
zfs umount ZFSStor/Handbrake_Dataset

zfs umount ZFSStor/Jellyfin_Data/Config
zfs umount ZFSStor/Jellyfin_Data/Customization
zfs umount ZFSStor/Jellyfin_Data/Content
zfs umount ZFSStor/Jellyfin_Data/SourceCollection
zfs umount ZFSStor/Jellyfin_Data/TranscodeData
zfs umount ZFSStor/Jellyfin_Data

zfs umount ZFSStor/HomeAssistant_Dataset/Config
zfs umount ZFSStor/HomeAssistant_Dataset/Media_Storage
zfs umount ZFSStor/HomeAssistant_Dataset

zfs umount ZFSStor/ImageMirror_Backups

zfs umount ZFSStor/NextCloud_Data/AppData
zfs umount ZFSStor/NextCloud_Data/Postgres_Data
zfs umount ZFSStor/NextCloud_Data/UserData_Storage
zfs umount ZFSStor/NextCloud_Data

zfs umount ZFSStor/Vault

Any errors? Any “filesystem busy” messages?

Ran the lines one at a time. No errors or status messages:

root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate/Media_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Syncthing_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset/download_storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Customization
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Content
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/SourceCollection
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/TranscodeData
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset/Media_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/ImageMirror_Backups
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/AppData
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/Postgres_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/UserData_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data

Now run these again. I’m guessing that you’ll see much larger values for the directory sizes this time.

zfs mount | grep ZFSStor

du -hs --apparent-size /mnt/ZFSStor/*

Here is the output of both commands in one:

root@truenas[/]# zfs mount | grep ZFSStor
ZFSStor                         /mnt/ZFSStor
ZFSStor/Vault                   /mnt/ZFSStor/Vault
ZFSStor/.system                 /var/db/system
ZFSStor/.system/cores           /var/db/system/cores
ZFSStor/.system/nfs             /var/db/system/nfs
ZFSStor/.system/samba4          /var/db/system/samba4
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f  /var/db/system/configs-a79f32b3a852420ca0f9433c4fd6884f
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f  /var/db/system/netdata
ZFSStor/.system/cores           /var/lib/systemd/coredump
root@truenas[/]# du -hs --apparent-size /mnt/ZFSStor/*
599M    /mnt/ZFSStor/ESPHome_Data
151G    /mnt/ZFSStor/Frigate
63M     /mnt/ZFSStor/Handbrake_Dataset
380M    /mnt/ZFSStor/HomeAssistant_Dataset
2       /mnt/ZFSStor/ImageMirror_Backups
9.4T    /mnt/ZFSStor/Jellyfin_Data
7.8M    /mnt/ZFSStor/NGINX_Data
141K    /mnt/ZFSStor/NGINX_Scale_Data
168G    /mnt/ZFSStor/NextCloud_Data
779M    /mnt/ZFSStor/NextCloud_True
55M     /mnt/ZFSStor/Postgres_data
250G    /mnt/ZFSStor/Syncthing_Data
15G     /mnt/ZFSStor/Valheim
2       /mnt/ZFSStor/Vault
46M     /mnt/ZFSStor/Vaultwarden
116     /mnt/ZFSStor/ffmpeg-config
1.2K    /mnt/ZFSStor/ffmpeg-dtsac3

Looks like we have some Data in jellyfin, syncthing! Vault is reporting “2”. That is not a copy paste error. I have the same on my side.