Just lost over 1Tb of media files

Sounds to me like some Programm or app is altering permissions and the data is not shown because you “lost” permissions

1 Like

@TheColin21

Yes via a SMB share

Then @LarsR is probably right. Something is changing the permissions so you don’t see the files anymore.

You can adjust the dataset permissions using the GUI and also recursively apply them to all files in the dataset but if something is actively changing the permissions that won’t help long and you should find out what is doing that.

These are the permissions? for one of the datasets:

well only apps has permissions set. So if you use a different user to connect to the share that user cant see the data.
Edit:
Here’s an example of my Movies Dataset acls:

2 Likes

In the other thread, the Media dataset accounted for 2.47 TB, but now it clearly shows only 1.91 TB. Between then and now, something was deleted, skipped, or moved from the new/old Media dataset.

Did you ever “expand” it?


What do these show in the command-line now:

zpool list -o name,capacity,allocated,free <poolname>
zfs list -t fs,vol -o space,mountpoint -r <poolname>

Which dataset specifically?


Can you play the entire files in Plex or only view the thumbnails and titles?


@LarsR is correct. Only the “apps” user has permissions.

Not sure if you opened up ftp services on the nas. That might have left you open to intrusion. If you mount the drive space, you can try to scan it for deleted data. There are some ZFS recovery tools out there, but they do run a bit & depending on how important the data is to you, may have to pay up as lessoned learned. I lost a pool some years back, and there was hardly anything in existence for data retrieval. but looks like there are multiple options now that will get the job done.

@winnielinnie

To be honest I can’t specifically remember the amount of data usage for the said files.

AFAIK, I didn’t expand the pool, as I just left it at default.

The dataset is the films dataset

I can play the actual file in plex, but I only tried one file, no time to try all of them

root@freenas[~]# zpool list -o name,capacity,allocated,free WinShare   
NAME        CAP  ALLOC   FREE
WinShare    37%  3.38T  5.68T
root@freenas[~]# zfs list -t fs,vol -o space,mountpoint -r WinShare  
 
NAME                                                                      AVAIL   USED  USEDSNAP  USEDDS  USEDREFRESERV  USEDCHILD  MOUNTPOINT
WinShare                                                                  4.41T  2.70T        0B   35.4G             0B      2.67T  /mnt/WinShare
WinShare/.system                                                          4.41T  2.64G        0B   1.70G             0B       965M  legacy
WinShare/.system/configs-2c252f0045f7400bba077e5a4017475a                 4.41T   376M        0B    376M             0B         0B  legacy
WinShare/.system/configs-411517dcdf2b43f3a96114fb41a9292c                 4.41T   249K        0B    249K             0B         0B  legacy
WinShare/.system/cores                                                     917M   107M        0B    107M             0B         0B  legacy
WinShare/.system/netdata-2c252f0045f7400bba077e5a4017475a                 4.41T   408M        0B    408M             0B         0B  legacy
WinShare/.system/nfs                                                      4.41T   185K        0B    185K             0B         0B  legacy
WinShare/.system/rrd-2c252f0045f7400bba077e5a4017475a                     4.41T  36.6M        0B   36.6M             0B         0B  legacy
WinShare/.system/rrd-411517dcdf2b43f3a96114fb41a9292c                     4.41T   153K        0B    153K             0B         0B  legacy
WinShare/.system/rrd-f36704f2fe794cb6a75657843255655d                     4.41T   153K        0B    153K             0B         0B  legacy
WinShare/.system/samba4                                                   4.41T  3.59M     2.47M   1.12M             0B         0B  legacy
WinShare/.system/syslog-2c252f0045f7400bba077e5a4017475a                  4.41T  33.1M        0B   33.1M             0B         0B  legacy
WinShare/.system/syslog-411517dcdf2b43f3a96114fb41a9292c                  4.41T   799K        0B    799K             0B         0B  legacy
WinShare/.system/syslog-f36704f2fe794cb6a75657843255655d                  4.41T   268K        0B    268K             0B         0B  legacy
WinShare/.system/vm                                                       4.41T   153K        0B    153K             0B         0B  legacy
WinShare/.system/webui                                                    4.41T   141K        0B    141K             0B         0B  legacy
WinShare/Apps                                                             4.41T   256K        0B    256K             0B         0B  /mnt/WinShare/Apps
WinShare/Backup_Data                                                      4.41T   719G        0B    581G             0B       138G  /mnt/WinShare/Backup_Data
WinShare/Backup_Data/Arduino                                              4.41T   979M        0B    979M             0B         0B  /mnt/WinShare/Backup_Data/Arduino
WinShare/Backup_Data/BBC4Vidoes                                           4.41T  22.7G        0B   22.7G             0B         0B  /mnt/WinShare/Backup_Data/BBC4Vidoes
WinShare/Backup_Data/BBC4Vids                                             4.41T  90.6G        0B   90.6G             0B         0B  /mnt/WinShare/Backup_Data/BBC4Vids
WinShare/Backup_Data/Backgrounds                                          4.41T  32.5M        0B   32.5M             0B         0B  /mnt/WinShare/Backup_Data/Backgrounds
WinShare/Backup_Data/Caths_Backups                                        4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Backup_Data/Caths_Backups
WinShare/Backup_Data/Caths_Pics                                           4.41T   283M        0B    283M             0B         0B  /mnt/WinShare/Backup_Data/Caths_Pics
WinShare/Backup_Data/Documents                                            4.41T  22.2G        0B   22.2G             0B         0B  /mnt/WinShare/Backup_Data/Documents
WinShare/Backup_Data/Old_Documents                                        4.41T   760K        0B    760K             0B         0B  /mnt/WinShare/Backup_Data/Old_Documents
WinShare/Backup_Data/Pictures                                             4.41T  1.53G        0B   1.53G             0B         0B  /mnt/WinShare/Backup_Data/Pictures
WinShare/Backup_Data/Sketchbook                                           4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Backup_Data/Sketchbook
WinShare/Kerberos.io                                                      4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Kerberos.io
WinShare/Media                                                            4.41T  1.91T        0B    588K             0B      1.91T  /mnt/WinShare/Media
WinShare/Media/BBC4Vids                                                   4.41T  30.5G        0B   30.5G             0B       153K  /mnt/WinShare/Media/BBC4Vids
WinShare/Media/BBC4Vids/BBC4Vids                                          4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Media/BBC4Vids/BBC4Vids
WinShare/Media/Entertainment                                              4.41T   192K        0B    192K             0B         0B  /mnt/WinShare/Media/Entertainment
WinShare/Media/Films                                                      4.41T   330G        0B    330G             0B         0B  /mnt/WinShare/Media/Films
WinShare/Media/Music                                                      4.41T  74.6G        0B   74.6G             0B         0B  /mnt/WinShare/Media/Music
WinShare/Media/Old Films                                                  4.41T   192K        0B    192K             0B         0B  /mnt/WinShare/Media/Old Films
WinShare/Media/Plex                                                       4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Media/Plex
WinShare/Media/TV Shows                                                   4.41T  1.49T        0B   1.49T             0B         0B  /mnt/WinShare/Media/TV Shows
WinShare/Mediafiles                                                       4.41T   562M        0B    562M             0B         0B  /mnt/WinShare/Mediafiles
WinShare/Plex                                                             4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/Plex
WinShare/WindowsMedia                                                     4.41T   153K        0B    153K             0B         0B  /mnt/WinShare/WindowsMedia
WinShare/iocage                                                           4.41T  35.0G        0B   12.2M             0B      35.0G  /mnt/WinShare/iocage
WinShare/iocage/download                                                  4.41T  1.33G        0B    141K             0B      1.33G  /mnt/WinShare/iocage/download
WinShare/iocage/download/11.2-RELEASE                                     4.41T   272M        0B    272M             0B         0B  /mnt/WinShare/iocage/download/11.2-RELEASE
WinShare/iocage/download/11.3-RELEASE                                     4.41T   288M        0B    288M             0B         0B  /mnt/WinShare/iocage/download/11.3-RELEASE
WinShare/iocage/download/12.2-RELEASE                                     4.41T   402M        0B    402M             0B         0B  /mnt/WinShare/iocage/download/12.2-RELEASE
WinShare/iocage/download/13.0-RELEASE                                     4.41T   401M        0B    401M             0B         0B  /mnt/WinShare/iocage/download/13.0-RELEASE
WinShare/iocage/images                                                    4.41T   141K        0B    141K             0B         0B  /mnt/WinShare/iocage/images
WinShare/iocage/jails                                                     4.41T  27.4G        0B    153K             0B      27.4G  /mnt/WinShare/iocage/jails
WinShare/iocage/jails/Plex                                                4.41T  19.7G     6.49M    198K             0B      19.7G  /mnt/WinShare/iocage/jails/Plex
WinShare/iocage/jails/Plex/root                                           4.41T  19.7G     13.9G   5.78G             0B         0B  /mnt/WinShare/iocage/jails/Plex/root
WinShare/iocage/jails/emby                                                4.41T  7.66G     1.87M    211K             0B      7.66G  /mnt/WinShare/iocage/jails/emby
WinShare/iocage/jails/emby/root                                           4.41T  7.66G     3.75G   3.91G             0B         0B  /mnt/WinShare/iocage/jails/emby/root
WinShare/iocage/log                                                       4.41T   192K        0B    192K             0B         0B  /mnt/WinShare/iocage/log
WinShare/iocage/releases                                                  4.41T  6.29G        0B    141K             0B      6.29G  /mnt/WinShare/iocage/releases
WinShare/iocage/releases/11.2-RELEASE                                     4.41T  1.36G        0B    141K             0B      1.36G  /mnt/WinShare/iocage/releases/11.2-RELEASE
WinShare/iocage/releases/11.2-RELEASE/root                                4.41T  1.36G     40.6M   1.32G             0B         0B  /mnt/WinShare/iocage/releases/11.2-RELEASE/root
WinShare/iocage/releases/11.3-RELEASE                                     4.41T  1.36G        0B    141K             0B      1.36G  /mnt/WinShare/iocage/releases/11.3-RELEASE
WinShare/iocage/releases/11.3-RELEASE/root                                4.41T  1.36G        0B   1.36G             0B         0B  /mnt/WinShare/iocage/releases/11.3-RELEASE/root
WinShare/iocage/releases/12.2-RELEASE                                     4.41T  1.82G        0B    153K             0B      1.82G  /mnt/WinShare/iocage/releases/12.2-RELEASE
WinShare/iocage/releases/12.2-RELEASE/root                                4.41T  1.82G        0B   1.82G             0B         0B  /mnt/WinShare/iocage/releases/12.2-RELEASE/root
WinShare/iocage/releases/13.0-RELEASE                                     4.41T  1.75G        0B    153K             0B      1.75G  /mnt/WinShare/iocage/releases/13.0-RELEASE
WinShare/iocage/releases/13.0-RELEASE/root                                4.41T  1.75G        0B   1.75G             0B         0B  /mnt/WinShare/iocage/releases/13.0-RELEASE/root
WinShare/iocage/templates                                                 4.41T   141K        0B    141K             0B         0B  /mnt/WinShare/iocage/templates
WinShare/ix-applications                                                  4.41T  5.41G      665K    792K             0B      5.41G  /mnt/WinShare/ix-applications
WinShare/ix-applications/catalogs                                         4.41T  62.2M        0B   62.2M             0B         0B  /mnt/WinShare/ix-applications/catalogs
WinShare/ix-applications/default_volumes                                  4.41T   256K      102K    153K             0B         0B  /mnt/WinShare/ix-applications/default_volumes
WinShare/ix-applications/k3s                                              4.41T  5.33G     53.1M   5.28G             0B       601K  /mnt/WinShare/ix-applications/k3s
WinShare/ix-applications/k3s/kubelet                                      4.41T   601K        0B    601K             0B         0B  legacy
WinShare/ix-applications/releases                                         4.41T  16.4M      422K    166K             0B      15.8M  /mnt/WinShare/ix-applications/releases
WinShare/ix-applications/releases/emby                                    4.41T  3.17M      115K    166K             0B      2.90M  /mnt/WinShare/ix-applications/releases/emby
WinShare/ix-applications/releases/emby/charts                             4.41T   780K      217K    562K             0B         0B  /mnt/WinShare/ix-applications/releases/emby/charts
WinShare/ix-applications/releases/emby/volumes                            4.41T  2.13M      102K    153K             0B      1.88M  /mnt/WinShare/ix-applications/releases/emby/volumes
WinShare/ix-applications/releases/emby/volumes/ix_volumes                 4.41T  1.88M      102K    153K             0B      1.64M  /mnt/WinShare/ix-applications/releases/emby/volumes/ix_volumes
WinShare/ix-applications/releases/emby/volumes/ix_volumes/config          4.41T  1.64M        0B   1.64M             0B         0B  /mnt/WinShare/ix-applications/releases/emby/volumes/ix_volumes/config
WinShare/ix-applications/releases/jellyfin                                4.41T  2.27M      115K    166K             0B      2.00M  /mnt/WinShare/ix-applications/releases/jellyfin
WinShare/ix-applications/releases/jellyfin/charts                         4.41T   639K      115K    524K             0B         0B  /mnt/WinShare/ix-applications/releases/jellyfin/charts
WinShare/ix-applications/releases/jellyfin/volumes                        4.41T  1.37M      102K    153K             0B      1.12M  /mnt/WinShare/ix-applications/releases/jellyfin/volumes
WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes             4.41T  1.12M      217K    179K             0B       754K  /mnt/WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes
WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/cache       4.41T   243K        0B    243K             0B         0B  /mnt/WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/cache
WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/config      4.41T   256K      102K    153K             0B         0B  /mnt/WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/config
WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/transcodes  4.41T   256K      102K    153K             0B         0B  /mnt/WinShare/ix-applications/releases/jellyfin/volumes/ix_volumes/transcodes
WinShare/ix-applications/releases/plex                                    4.41T  10.4M      115K    166K             0B      10.1M  /mnt/WinShare/ix-applications/releases/plex
WinShare/ix-applications/releases/plex/charts                             4.41T  1.12M      320K    831K             0B         0B  /mnt/WinShare/ix-applications/releases/plex/charts
WinShare/ix-applications/releases/plex/volumes                            4.41T  8.96M      102K    153K             0B      8.71M  /mnt/WinShare/ix-applications/releases/plex/volumes
WinShare/ix-applications/releases/plex/volumes/ix_volumes                 4.41T  8.71M      230K    166K             0B      8.32M  /mnt/WinShare/ix-applications/releases/plex/volumes/ix_volumes
WinShare/ix-applications/releases/plex/volumes/ix_volumes/config          4.41T  7.98M        0B   7.98M             0B         0B  /mnt/WinShare/ix-applications/releases/plex/volumes/ix_volumes/config
WinShare/ix-applications/releases/plex/volumes/ix_volumes/data            4.41T   102K        0B    102K             0B         0B  /mnt/WinShare/ix-applications/releases/plex/volumes/ix_volumes/data
WinShare/ix-applications/releases/plex/volumes/ix_volumes/logs            4.41T   102K        0B    102K             0B         0B  /mnt/WinShare/ix-applications/releases/plex/volumes/ix_volumes/logs
WinShare/ix-applications/releases/plex/volumes/ix_volumes/transcode       4.41T   141K        0B    141K             0B         0B  /mnt/WinShare/ix-applications/releases/plex/volumes/ix_volumes/transcode
WinShare/ix-apps                                                          4.41T  13.7G      109K    249K             0B      13.7G  /mnt/.ix-apps
WinShare/ix-apps/app_configs                                              4.41T  10.7M     3.48M   7.26M             0B         0B  /mnt/.ix-apps/app_configs
WinShare/ix-apps/app_mounts                                               4.41T  4.46G      115K    166K             0B      4.46G  /mnt/.ix-apps/app_mounts
WinShare/ix-apps/app_mounts/emby                                          4.41T   198M      102K    153K             0B       197M  /mnt/.ix-apps/app_mounts/emby
WinShare/ix-apps/app_mounts/emby/config                                   4.41T   197M     88.5M    109M             0B         0B  /mnt/.ix-apps/app_mounts/emby/config
WinShare/ix-apps/app_mounts/esphome                                       4.41T   307K        0B    153K             0B       153K  /mnt/.ix-apps/app_mounts/esphome
WinShare/ix-apps/app_mounts/esphome/config                                4.41T   153K        0B    153K             0B         0B  /mnt/.ix-apps/app_mounts/esphome/config
WinShare/ix-apps/app_mounts/finjelly                                      4.41T  1016K        0B    166K             0B       850K  /mnt/.ix-apps/app_mounts/finjelly
WinShare/ix-apps/app_mounts/finjelly/cache                                4.41T   358K        0B    358K             0B         0B  /mnt/.ix-apps/app_mounts/finjelly/cache
WinShare/ix-apps/app_mounts/finjelly/config                               4.41T   492K        0B    492K             0B         0B  /mnt/.ix-apps/app_mounts/finjelly/config
WinShare/ix-apps/app_mounts/jellyfin                                      4.41T  40.0M      115K    179K             0B      39.7M  /mnt/.ix-apps/app_mounts/jellyfin
WinShare/ix-apps/app_mounts/jellyfin/BBC4Vids                             4.41T   166K        0B    166K             0B         0B  /mnt/.ix-apps/app_mounts/jellyfin/BBC4Vids
WinShare/ix-apps/app_mounts/jellyfin/BBC4_Videos                          4.41T   153K        0B    153K             0B         0B  /mnt/.ix-apps/app_mounts/jellyfin/BBC4_Videos
WinShare/ix-apps/app_mounts/jellyfin/cache                                4.41T  38.1M     37.8M    351K             0B         0B  /mnt/.ix-apps/app_mounts/jellyfin/cache
WinShare/ix-apps/app_mounts/jellyfin/config                               4.41T  1.10M      403K    722K             0B         0B  /mnt/.ix-apps/app_mounts/jellyfin/config
WinShare/ix-apps/app_mounts/jellyfin/storage_entry                        4.41T   166K        0B    166K             0B         0B  /mnt/.ix-apps/app_mounts/jellyfin/storage_entry
WinShare/ix-apps/app_mounts/plex                                          4.41T  4.23G      153K    192K             0B      4.23G  /mnt/.ix-apps/app_mounts/plex
WinShare/ix-apps/app_mounts/plex/Media                                    4.41T   153K        0B    153K             0B         0B  /mnt/.ix-apps/app_mounts/plex/Media
WinShare/ix-apps/app_mounts/plex/config                                   4.41T  3.98G     2.06G   1.91G             0B         0B  /mnt/.ix-apps/app_mounts/plex/config
WinShare/ix-apps/app_mounts/plex/data                                     4.41T   256K      102K    153K             0B         0B  /mnt/.ix-apps/app_mounts/plex/data
WinShare/ix-apps/app_mounts/plex/logs                                     4.41T   256K      102K    153K             0B         0B  /mnt/.ix-apps/app_mounts/plex/logs
WinShare/ix-apps/app_mounts/plex/transcode                                4.41T   253M     1.71M    251M             0B         0B  /mnt/.ix-apps/app_mounts/plex/transcode
WinShare/ix-apps/docker                                                   4.41T  8.72G        0B   8.72G             0B         0B  /mnt/.ix-apps/docker
WinShare/ix-apps/truenas_catalog                                          4.41T   553M        0B    553M             0B         0B  /mnt/.ix-apps/truenas_catalog
WinShare/stacks                                                           4.41T   179K        0B    179K             0B         0B  /mnt/WinShare/stacks

The first thing i would try is adding your username back to the acl list and apply the acls recursively and for child datasets and see if you can access your data again.

3 Likes

@Glitch01

No I didn’t open up ftp services.

@LarsR

thanks and after I changed the permissions on the media datasets similar to yours, I now hav ethe media files showing again in the respective folders.

I never had this performance before with permissions etc, as the media files were there all the time with basic permissions.

I have just added my username to the permissions list, and yes I can access the data again.

thanks

2 Likes

Just a rule of thumb: it’s always either dns or permissions :joy:

4 Likes

I have now enabled snapshots of my media folders

4 Likes

Snapshots will help with accidental data deletion, but not if someting f***s up the permissions.

Oh dear! I was hoping that it would help if my files disappeared again, But if the permissions get f*****d up I can at least change them back, I hope.

…or having a directory with the same name as a dataset. :confounded_face:

5 Likes

Not just snapshots, but a BACKUP of your data. Snapshots are not backups unless they are being replicated properly to a separate drive outside of that system. If you don’t use replication then copy all the data to a different drive. There’s no reason (laziness, cost, etc.) you shouldn’t have a spare drive somewhere with your data on it.

3 Likes

Unfortunately I don’t have a spare drive big enough to use to backup my data.

I have been using FreeNAS, then TrueNAS for over 12/13 years, and apart from replacing a disc a few years back, never had any problems with my data, as it was always there . Permissions wise I just used nobody and nogroup, which allowed me to play the media files on plex or whatever app I used at the time, and none of the data disappeared.

Thanks

:zipper_mouth_face:

2 Likes

I get where you’re coming from too Frank, but to be fair to OP - these are media files.

Though I agree that this should be a good lesson to make actual backups of critical files, as well as all the other good practices like regular smart tests, scrubs, and snapshots, etc.

1 Like