Hi,
I’ve started replicating my TrueNAS SCALE volume to a FreeBSD box again. I used to do this before using TrueNAS CORE - and it worked well.
Replication ‘works’ (all the data is copied across) - but every day I end up with an alert on TrueNAS SCALE that says:
Replication "vol/replicated - Daily vol" failed: send from @auto-...
[list of all the snapshots sent]
cannot set property for 'vol//replicated': permission denied..
Replication does ‘work’ (i.e. on the destination I can see all the data - and it looks fine) - but looks like it’s failing at a final hurdle.
TrueNAS SCALE doesn’t tell me which permission it cannot set.
When setting this up - I did get some meaningful errors, such as “cannot set sharesmb property for ‘vol/destination/replicated’” - but having done the requisite ‘zfs allow’ on the destination - it now it just simply says “cannot set permission” without telling me which permission it’s failing to set.
So far I’ve:
- Tried ‘log level: Debug’ on TrueNAS SCALE (this didn’t offer any more insight) you get more log info, but ultimately it just ends in the same ‘cannot set permission’ without saying which one.
- I’ve run up ‘auditd’ on the destination (which logs all the commands being run via ssh by TrueNAS SCALE) - according to auditd, every single command executed as part of the replication ends in ‘success’ - i.e. no failures.
If I re-run the replication after this alert, it runs very quickly (as there is nothing to copy until the next snapshot run is done) - and completes without any warning (the red ‘Error’ replication task icon, goes green).
Anyone know what I can do to debug this further? (i.e. try and figure out which permission it’s trying to set - that fails?)
Like I said - all the data is there, so suspect it’s something trying to set a permission as a kind of ‘final / cleanup’ phase - that’s not working.
But even from the remote - I cannot see any command the sender executes on the remote - that ends in ‘failure’ - they all complete OK (return code: 0).