Thanks all good replies
In the past I have tryed several things,
-
Splitting the data in the pool to directory segments (so data can be split manually to fit multiple difrent size drives) and copy data from them separately to diffrent usb drives.
– When using NTFS, it works great even with SMR drives and allows using compression at the same time.
— When doing the copy with Teracopy I can also use checksum counting to test that the copy is ok and it can be verified.
– Drives can be disconnect when not in used and stored to safety.
→ But lot of short backs, I would really want to move on to better way of backuping. -
If using Cobian Backup / Cobian Reflector I can also take 7zip compressed Full+Incremental backups and automate what to copy, where to copy and how many copies to keep, issue commads after the copy (sleep drives), etc.
– Its free, but not open source
— Heading to eol if it does not find programmers to continue the project
→ Maybe one could be interest to port it to Linux/Freebsd and make it part of Truenas?
I am having ideas of a script…
- Where is a list of the drives used for backup,their “64-bit World Wide ID” and what backup group/plan the drives is parting.
–This allows to detect what to do to to all the backup drives when they are connected or needed to be mounted etc.
– In the first iteration go for manual before planning anyting automatic to do when usb drives is connected.
- The use compression to split the data to multiple drives, (like we used compression in the past to split data to multiple floppy disks Compression also adds CRC so it can be verified.
I am not shure jet is it any good idea to try to use someting like
-
mergerfs to “combine” the disk.
– users are requesting mergerfs be made part of TrueNAS -
SnapRAID Looks also a promising, specially the comparision
-
“spanning drives” method to just add drives together, they would still nee to be able to work by them self.
– Any raid-0 type is out of the questions.
Also thinking that maybe file list + checksum would be good to be take and used to as a log/db where to compare changes so incremental backups could be easily taken whiteout needing to read all the backup disk involved.
- This would really help that you would not need to connect all the usb drives to just backup the changes to new usb drive etc.
Still in the alpha stage of just thinking about it and wondering still that there has to be way someone has alredy been thinking about this in the past and solved it alredy way better than I can even imagine…