I use TrueNAS to store weekly backups and other data for my systems at home, no VMs or other apps.
Last time I transferred a 700GB system backup from another PC, I noticed the available RAM in my server’s GUI was dwindling to almost nothing, then stopped the transfer.
I’m using 8x 4TB drives in a single pool as RAID-Z3, and currently have 64GB of RAM installed.
I’m also considering adding another identical pool or two for added redundancy in the future, will that require even more RAM?
That’s normal–your system has the RAM, so ZFS ought to use it. For your pool, 64 GB are enough. More is likely to be better, but check your ARC stats in the Reporting pages. But you don’t need more RAM based on what you’ve described.
The likelihood that you can benefit significantly with 64 GB of RAM and 20 TB of usable pool capacity is pretty small. But, again, TrueNAS has instrumentation to help you out here.
What makes you think, as you’ve titled the thread, that you need to increase your RAM?
I don’t think your system would operate much different with more RAM if your measure is writing a single large file.
Let me toss in a wrench… why is the ARC filling up so quickly? You are not able to write data faster than your current pool layout.
If there is a transfer rate issue, fix the pool layout.
Honestly, it sounds like your system is running fine. It will not run out of RAM because if the system needs more RAM, it will take some back that it loaned to the ARC.
That is absolutely what it is supposed to look like. What would you suggest the system do with that RAM instead?
Unused RAM is wasted RAM. If you add e.g. VMs to your configuration they will get their configured share of your physical memory but the ARC will always fill up the rest sooner or later. That is the point of a cache.
All RAM which is not used by anything different will be used as cache. In any modern operating system.