Brian9
June 13, 2025, 3:08pm
1
System:
AMD 5600X
64GB ECC memory
Intel Arc 380
RaidZ1 3X 18TB main storage
Mirrored 2x 512GB app drive
After update to ElectricEel-24.10.2.2 from 24.10.2.1 All datasets shared with samba are empty. The drives usage reports disk usage of what I would expect for that data in the UI storage tab but Smaba on windows and SFTP report the folders empty. Folders that are stet up in the datasets are present but their contents that used to be present before the update is now empty.
I have tried reverting to my previous saved config on the last, 10.2.1 boot environment, but my data is still missing.
I am missing ruffly 14TB of personal data after updating to 10.2.2, I am at a loss on things to diagnose or try. Any help would be appreciated.
So that we’re certain:
zfs list -t filesystem,vol -r -o space <poolname>
This could be a permissions issue or something wrong on your Windows client.
See if the files are visible using the command-line in the Shell or an SSH session. Use ls
in one of the directories.
Brian9
June 13, 2025, 4:56pm
3
The above command lists the samba stores as empty, same as the datasets UI
Jellyfin_Data
Syncthing_Data
Vault
Were all my samba shares
root@truenas[~]# zfs list -t filesystem,vol -r -o space ZFSStor
NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCHILD
ZFSStor 18.0T 14.6T 281G 14.1T 0B 173G
ZFSStor/.system 18.0T 3.86G 4.04M 1.48G 0B 2.38G
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f 18.0T 117M 501K 116M 0B 0B
ZFSStor/.system/cores 1020M 4.10M 3.94M 160K 0B 0B
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f 18.0T 2.26G 1.71G 565M 0B 0B
ZFSStor/.system/nfs 18.0T 533K 384K 149K 0B 0B
ZFSStor/.system/samba4 18.0T 1.71M 1.16M 565K 0B 0B
ZFSStor/Frigate 18.0T 2.34G 85.2K 139K 0B 2.34G
ZFSStor/Frigate/Config 18.0T 27.9M 9.06M 18.9M 0B 0B
ZFSStor/Frigate/Media_Storage 18.0T 2.31G 1.26G 1.05G 0B 0B
ZFSStor/Handbrake_Dataset 18.0T 384K 0B 128K 0B 256K
ZFSStor/Handbrake_Dataset/Config 18.0T 128K 0B 128K 0B 0B
ZFSStor/Handbrake_Dataset/download_storage 18.0T 128K 0B 128K 0B 0B
ZFSStor/HomeAssistant_Dataset 18.0T 719K 0B 139K 0B 581K
ZFSStor/HomeAssistant_Dataset/Config 18.0T 453K 85.2K 368K 0B 0B
ZFSStor/HomeAssistant_Dataset/Media_Storage 18.0T 128K 0B 128K 0B 0B
ZFSStor/ImageMirror_Backups 18.0T 224K 85.2K 139K 0B 0B
ZFSStor/Jellyfin_Data 18.0T 778K 0B 139K 0B 639K
ZFSStor/Jellyfin_Data/Config 18.0T 128K 0B 128K 0B 0B
ZFSStor/Jellyfin_Data/Content 18.0T 128K 0B 128K 0B 0B
ZFSStor/Jellyfin_Data/Customization 18.0T 128K 0B 128K 0B 0B
ZFSStor/Jellyfin_Data/SourceCollection 18.0T 128K 0B 128K 0B 0B
ZFSStor/Jellyfin_Data/TranscodeData 18.0T 128K 0B 128K 0B 0B
ZFSStor/NextCloud_Data 18.0T 167G 95.9K 160K 0B 167G
ZFSStor/NextCloud_Data/AppData 18.0T 167G 0B 167G 0B 0B
ZFSStor/NextCloud_Data/Postgres_Data 18.0T 128K 0B 128K 0B 0B
ZFSStor/NextCloud_Data/UserData_Storage 18.0T 128K 0B 128K 0B 0B
ZFSStor/Syncthing_Data 18.0T 128K 0B 128K 0B 0B
ZFSStor/Vault 18.0T 128K 0B 128K 0B 0B
This is why.
You’re storing files directly inside the root dataset . You should never do this. This must have been from an older version of TrueNAS, before they had locked the root dataset permissions from being modified.
What you’re seeing are folders that share the same name as datasets . However, the folders that you saved your data inside are being overlaid by empty datasets that have the same names. That’s why the path is empty when you try to browse it.
You need to safely move everything into their respective datasets. This requires you to temporarily rename your datasets so that they don’t overlay the existing folders. Do the move operation. Safely delete the now empty folders. Finally, rename your datasets back to their original names.
I would stop any SMB or NFS service and stop any Apps while you do this, and make sure no clients are using the server.
1 Like
Brian9
June 13, 2025, 5:18pm
5
Thank you for helping me with this… I am a bit confused by what you mean by the “root dataset” when using ssh or ftp to look at the server under the mnt directory there are none of the reported ~14Tb files. Is there somewhere else I should be looking for my missing files?
This must have been from an older version of TrueNAS, before they had locked the root dataset permissions from being modified
I had created these datasets from the UI about 2 months ago on 24.10.2.1 migrating from a different set of drives. I created the datasets through the UI but I migrated the data to them from older drives over ftp
I apologize for not having good background knowledge on issues like this but truly appriciate the help!
With the Shell or SSH, what is the result of these commands?
ls -l /mnt/ZFSStor
du -hs --apparent-size /mnt/ZFSStor/*
zfs mount | grep ZFSStor
zfs list -t filesystem -o name,mountpoint -d1 ZFSStor
Brian9
June 13, 2025, 5:29pm
7
Here they are:
ls -l /mnt/ZFSStor
total 82
drwxr-xr-x 4 root root 13 Sep 13 2024 ESPHome_Data
drwxrwx--- 5 root root 5 Jun 13 07:17 Frigate
drwxrwx--- 4 root root 4 Apr 29 19:21 Handbrake_Dataset
drwxrwx--- 4 root root 4 Apr 29 19:49 HomeAssistant_Dataset
drwxr-xr-x 4 root root 4 Mar 29 2024 ImageMirror_Backups
drwxrwx--- 7 root root 7 Apr 29 19:21 Jellyfin_Data
drwxrwxr-x 7 apps apps 9 Nov 1 2024 NGINX_Data
drwxr-xr-x 7 apps apps 9 Jun 14 2024 NGINX_Scale_Data
drwxrwx--- 7 root root 7 Jun 13 07:17 NextCloud_Data
drwxrwx--- 17 www-data www-data 38 Apr 18 21:50 NextCloud_True
drwx------ 19 netdata docker 25 Apr 18 21:53 Postgres_data
drwxrwx--- 3 root root 3 Apr 29 19:53 Syncthing_Data
drwxrwxr-x 4 apps apps 4 Mar 10 2024 Valheim
drwxrwx--- 2 root root 2 Apr 29 20:26 Vault
drwxr-xr-x 4 root root 4 Nov 1 2024 Vaultwarden
drwxr-xr-x 3 root root 3 Dec 15 2023 ffmpeg-config
drwxr-xr-x 2 root root 3 Dec 15 2023 ffmpeg-dtsac3
du -hs --apparent-size /mnt/ZFSStor/*
599M /mnt/ZFSStor/ESPHome_Data
1.2G /mnt/ZFSStor/Frigate
8 /mnt/ZFSStor/Handbrake_Dataset
199K /mnt/ZFSStor/HomeAssistant_Dataset
8 /mnt/ZFSStor/ImageMirror_Backups
17 /mnt/ZFSStor/Jellyfin_Data
7.8M /mnt/ZFSStor/NGINX_Data
141K /mnt/ZFSStor/NGINX_Scale_Data
167G /mnt/ZFSStor/NextCloud_Data
779M /mnt/ZFSStor/NextCloud_True
55M /mnt/ZFSStor/Postgres_data
5 /mnt/ZFSStor/Syncthing_Data
15G /mnt/ZFSStor/Valheim
2 /mnt/ZFSStor/Vault
46M /mnt/ZFSStor/Vaultwarden
116 /mnt/ZFSStor/ffmpeg-config
1.2K /mnt/ZFSStor/ffmpeg-dtsac3
zfs mount | grep ZFSStor
ZFSStor /mnt/ZFSStor
ZFSStor/Frigate /mnt/ZFSStor/Frigate
ZFSStor/Syncthing_Data /mnt/ZFSStor/Syncthing_Data
ZFSStor/Frigate/Media_Storage /mnt/ZFSStor/Frigate/Media_Storage
ZFSStor/Handbrake_Dataset /mnt/ZFSStor/Handbrake_Dataset
ZFSStor/Jellyfin_Data /mnt/ZFSStor/Jellyfin_Data
ZFSStor/HomeAssistant_Dataset /mnt/ZFSStor/HomeAssistant_Dataset
ZFSStor/ImageMirror_Backups /mnt/ZFSStor/ImageMirror_Backups
ZFSStor/HomeAssistant_Dataset/Config /mnt/ZFSStor/HomeAssistant_Dataset/Config
ZFSStor/Jellyfin_Data/SourceCollection /mnt/ZFSStor/Jellyfin_Data/SourceCollection
ZFSStor/Jellyfin_Data/TranscodeData /mnt/ZFSStor/Jellyfin_Data/TranscodeData
ZFSStor/Handbrake_Dataset/download_storage /mnt/ZFSStor/Handbrake_Dataset/download_storage
ZFSStor/NextCloud_Data /mnt/ZFSStor/NextCloud_Data
ZFSStor/Frigate/Config /mnt/ZFSStor/Frigate/Config
ZFSStor/Vault /mnt/ZFSStor/Vault
ZFSStor/Jellyfin_Data/Customization /mnt/ZFSStor/Jellyfin_Data/Customization
ZFSStor/Jellyfin_Data/Content /mnt/ZFSStor/Jellyfin_Data/Content
ZFSStor/Handbrake_Dataset/Config /mnt/ZFSStor/Handbrake_Dataset/Config
ZFSStor/Jellyfin_Data/Config /mnt/ZFSStor/Jellyfin_Data/Config
ZFSStor/HomeAssistant_Dataset/Media_Storage /mnt/ZFSStor/HomeAssistant_Dataset/Media_Storage
ZFSStor/NextCloud_Data/AppData /mnt/ZFSStor/NextCloud_Data/AppData
ZFSStor/NextCloud_Data/Postgres_Data /mnt/ZFSStor/NextCloud_Data/Postgres_Data
ZFSStor/NextCloud_Data/UserData_Storage /mnt/ZFSStor/NextCloud_Data/UserData_Storage
ZFSStor/.system /var/db/system
ZFSStor/.system/cores /var/db/system/cores
ZFSStor/.system/nfs /var/db/system/nfs
ZFSStor/.system/samba4 /var/db/system/samba4
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f /var/db/system/configs-a79f32b3a852420ca0f9433c4fd6884f
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f /var/db/system/netdata
ZFSStor/.system/cores /var/lib/systemd/coredump
zfs list -t filesystem -o name -d1 ZFSStor
NAME
ZFSStor
ZFSStor/.system
ZFSStor/Frigate
ZFSStor/Handbrake_Dataset
ZFSStor/HomeAssistant_Dataset
ZFSStor/ImageMirror_Backups
ZFSStor/Jellyfin_Data
ZFSStor/NextCloud_Data
ZFSStor/Syncthing_Data
ZFSStor/Vault
This is going to require some manual intervention, which could interfere with currently running apps and services, and it will probably confuse the middleware.
Are you willing to stop all services (except SSH), all shares, and make sure no one is connected to the NAS? You can’t safely continue otherwise.
Brian9
June 13, 2025, 5:34pm
10
For sure. Everything is down now. All apps and samba.
Are you using SSH or the “Shell” in the GUI for these commands?
Brian9
June 13, 2025, 5:34pm
12
I have the putty application connected via ssh
1 Like
Close any pages that have the TrueNAS GUI open.
Before anything, create a checkpoint for your pool:
zpool checkpoint ZFSStor
zpool status | grep checkpoint
Check if your pool supports block-cloning.
zpool get feature@block_cloning
Brian9
June 13, 2025, 5:38pm
14
Thank you for holding my hand through this.
checkpoint: created Fri Jun 13 11:37:29 2025, consumes 1008K
zpool get feature@block_cloning
NAME PROPERTY VALUE SOURCE
ZFSStor feature@block_cloning active local
boot-pool feature@block_cloning active local
image mirror feature@block_cloning active local
Are you using any encrypted datasets?
Here’s where the server or middleware might freak out.
Unmount these datasets one by one in this order.
Don’t rush this part.
zfs umount ZFSStor/Frigate/Media_Storage
zfs umount ZFSStor/Frigate/Config
zfs umount ZFSStor/Frigate
zfs umount ZFSStor/Syncthing_Data
zfs umount ZFSStor/Handbrake_Dataset/download_storage
zfs umount ZFSStor/Handbrake_Dataset/Config
zfs umount ZFSStor/Handbrake_Dataset
zfs umount ZFSStor/Jellyfin_Data/Config
zfs umount ZFSStor/Jellyfin_Data/Customization
zfs umount ZFSStor/Jellyfin_Data/Content
zfs umount ZFSStor/Jellyfin_Data/SourceCollection
zfs umount ZFSStor/Jellyfin_Data/TranscodeData
zfs umount ZFSStor/Jellyfin_Data
zfs umount ZFSStor/HomeAssistant_Dataset/Config
zfs umount ZFSStor/HomeAssistant_Dataset/Media_Storage
zfs umount ZFSStor/HomeAssistant_Dataset
zfs umount ZFSStor/ImageMirror_Backups
zfs umount ZFSStor/NextCloud_Data/AppData
zfs umount ZFSStor/NextCloud_Data/Postgres_Data
zfs umount ZFSStor/NextCloud_Data/UserData_Storage
zfs umount ZFSStor/NextCloud_Data
zfs umount ZFSStor/Vault
Any errors? Any “filesystem busy” messages?
Brian9
June 13, 2025, 5:52pm
18
Ran the lines one at a time. No errors or status messages:
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate/Media_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Frigate
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Syncthing_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset/download_storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Handbrake_Dataset
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Customization
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/Content
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/SourceCollection
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data/TranscodeData
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/Jellyfin_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset/Config
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset/Media_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/HomeAssistant_Dataset
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/ImageMirror_Backups
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/AppData
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/Postgres_Data
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data/UserData_Storage
root@truenas[/mnt/ZFSStor]# zfs umount ZFSStor/NextCloud_Data
Now run these again. I’m guessing that you’ll see much larger values for the directory sizes this time.
zfs mount | grep ZFSStor
du -hs --apparent-size /mnt/ZFSStor/*
Brian9
June 13, 2025, 5:58pm
20
Here is the output of both commands in one:
root@truenas[/]# zfs mount | grep ZFSStor
ZFSStor /mnt/ZFSStor
ZFSStor/Vault /mnt/ZFSStor/Vault
ZFSStor/.system /var/db/system
ZFSStor/.system/cores /var/db/system/cores
ZFSStor/.system/nfs /var/db/system/nfs
ZFSStor/.system/samba4 /var/db/system/samba4
ZFSStor/.system/configs-a79f32b3a852420ca0f9433c4fd6884f /var/db/system/configs-a79f32b3a852420ca0f9433c4fd6884f
ZFSStor/.system/netdata-a79f32b3a852420ca0f9433c4fd6884f /var/db/system/netdata
ZFSStor/.system/cores /var/lib/systemd/coredump
root@truenas[/]# du -hs --apparent-size /mnt/ZFSStor/*
599M /mnt/ZFSStor/ESPHome_Data
151G /mnt/ZFSStor/Frigate
63M /mnt/ZFSStor/Handbrake_Dataset
380M /mnt/ZFSStor/HomeAssistant_Dataset
2 /mnt/ZFSStor/ImageMirror_Backups
9.4T /mnt/ZFSStor/Jellyfin_Data
7.8M /mnt/ZFSStor/NGINX_Data
141K /mnt/ZFSStor/NGINX_Scale_Data
168G /mnt/ZFSStor/NextCloud_Data
779M /mnt/ZFSStor/NextCloud_True
55M /mnt/ZFSStor/Postgres_data
250G /mnt/ZFSStor/Syncthing_Data
15G /mnt/ZFSStor/Valheim
2 /mnt/ZFSStor/Vault
46M /mnt/ZFSStor/Vaultwarden
116 /mnt/ZFSStor/ffmpeg-config
1.2K /mnt/ZFSStor/ffmpeg-dtsac3
Looks like we have some Data in jellyfin, syncthing! Vault is reporting “2”. That is not a copy paste error. I have the same on my side.