I have a NAS-system that I’ve built myself back in 2017. Right now the server uses two mirrored USB-memory sticks as boot drive.
I plan on making a small upgrade to this server by switching to something better for boot drive.
(The server is currently “stuck” on FreeNAS 11.3, since TrueNAS 12 introduced higher demands on the boot drive and USB-memory sticks are not recommended for boot drive.)
So I have been looking around some and thinking about what could be a good choice for upgrading the boot drive.
I really like how FreeNAS 11.3 and older could be run off USB-memory sticks. Ideally I would like to stay as close to this as possible.
Right now, what I am thinking is to switch to Verbatim Vx500 External SSD (x2 mirrored) that connects using USB.
Questions:
Do you think using external SSD is an ok idea for TrueNAS boot drive? Or is this a bad idea for some reasons?
I would not experience any problems with external SSDs? Like that they go idle / sleep mode or something?
Is there a guide on how to switch out boot-drive? I have the impression that it is a bit tricky operation.
Avoid USB. Completely. Period.
Do you use all of the 6 SATA ports?
Is the PCIe slot used?
A single small SATA SSD is much more reliable than a pair of USB sticks.
USB generally sucks for stable connectivity as they really are not built for that. Youwould be much better served with a couple of small SSDs or NVME drives as boot mirror, but make sure you get something build for NAS applciations. I use WD Red SN700 nvme’s (which are about $60 for a 256gb) If you have any room on your SATA controllers, I would avoid USB.
For switching the boot drive, I am not sure of your current configuration. If everything is in ZFS pools except and nothing is in your boot pools except TNAS OS, the easiest thing to do is save your running configuration, install the new boot drives and take the USB drives out, then install the SAME version of TrueNAS, restore the config and import your pools. I have done this several times with great success with Scale (including migrating off Proxmox to TNAS bare metal)
The biggest problem with USB flash drives is they tend to be dirt cheap. Thus less reliable than even the cheapest SATA SSD. Those Cruzer Fit are reliable, though if you have been using them since 2017, they likely won’t last much longer.
Many people find USB to SATA or USB to NVMe adapters to be quite suitable for their use as TrueNAS boot devices. Even to the point of not bothering to mirror them. You then select a small, suitable SATA or NVMe drive and off you go.
If you have an extra SATA port or 2, internal 2.5" SSD, (or even the more expensive SATA DOMs), can be an option.
Their are companies that produce reliable USB flash drives, that act more like SSDs. Meaning they may have spare sectors and better error handling. For example, these 2 manufacturers seem to have such, (I have no connection to them, nor any personal knowledge):
Last, the Verbatim Vx500 External SSD 240GB is over-kill for TrueNAS boot, even today. The 120GB model is better in that it is likely cheaper and more than enough space for TrueNAS. (TrueNAS still uses dedicated boot devices… just like FreeNAS did.)
There is no major issue using a normal SSD (SATA/NVMe) via a USB bridge for a boot device. But please don’t use one for a data-pool.
Of course the issue with USB bridges is that it can be a crap shoot as to wether you buy a good one or a friday afternoon aliexpress special made from chinesium. If you get a good one then it works (I ran a TrueNAS NAS for a year or so on a pair of these mirrored without issue)
You can use a thumb drive, but if you do make sure you get a regular copy of the config file emailed to you (Multi_Report or similar) so if the boot device does crap out (be it a cheap USB thumb drive or a modern NVMe in a decent bridge device) then a re-install of the OS is very very VERY simple. (note that a copy of the config file saved off-NAS is very good practice anyhow)
Yes its annoying to have to do - but its very simple.
Eh, can’t quite agree here. A USB-connected SSB is OK for a boot device. It isn’t the greatest thing ever, and definitely a SATA SSD would be an improvement, but given the limited i/o to the boot device (and the minimal consequences of boot device failure) it’s an acceptable risk IMO, particularly if expansion options are limited for the server in question.
FWIW, my parents’ NAS (built on a HPE MicroServer Gen8, consequently with very limited i/o options) has been using a USB SSD as a boot device for CORE for the last 4+ years with no issues.
Consider that the PCI-ex>NVME boot capability Is not guaranteed on older mainboard… USB>SSD Is the most accettable compromise.
I didn’t have had any problem in months, SSD just die like he could attached via SATA… Instead of waste a disk for mirror be sure to have a recent config backup file + a replacement disk, so you come back in minutes in need
Edit: for the above link it will default to a mSATA to 2.5 SATA, you can select the USB 3.0 to mSATA, which is what I use and recommend.
And the following mSATA drive
I have one for my primary NAS and one for my backup NAS and I have a spare laying around. I’ve found that it works quite well and have not had any issues running boot drive this way for the past 3+ years.
I would echo sentiments mentioned above, do not use a “flash drive.” Use a more stable storage device. Using the USB connection for a stable storage device should be fine.
@Arwen mentioned industrial-grade usb-memory sticks, which really got me interested.
Usb-memory sticks with really good reliability could be a interesting alternative to my first idea.
I have done a bit of searching and I quickly discovered that industrial-grade usb-memory sticks apparently are not normally sold to private persons (only to businesses et.c.), so they’re hard to come by.
Anyway, I found this memory stick which is possible for me to buy and the specifications looks really good: Silicon Power UFD350
UFD350 (see also link to factsheet document at the bottom of the webpage)
PRODUCT FEATURES
3D TLC Flash Technology with 3K PE cycles endurance
Global Wear Leveling, Static & Dynamic Wear Leveling and Early weak block retirement to ensure an even level of wearing out
LDPC ECC engine with hardware decode, read retry & software decode capable to guarantee 3K PE cycles for 3D NAND
Auto Read-Refresh, Read retry, Garbage collection to ensure reliability and optimized performance
Endurance in Tera Bytes Written (TBW). 64GB: 144TBW
LDPC ECC engine to ensure reliable 3K PE cycles with 3D TLC NAND Flash
The only detail that I feel is a bit dubious is the guarantee of 3 years, I have seen some other usb-memory sticks with 5 year guarantees.
Nevertheless, this seems like a great quality usb-memory, and 144 TBW would mean that it will last really long.
USB sticks like this, at least where i live, are available for a price 2~3 times way more of a SSD/NVME+adapter.
Honestly i don’t see any benefit, but your call
On rare occasions, something that is a single device or smaller may be needed.
For example, neither my old or new laptop will boot off the SD Card slot / device. I can chain boot from my existing Linux “/boot” to the OS on the SD Card, so it is still a nice integrated backup. But, not a perfect recovery device if my primary boot device fails completely.
However, a mini USB drive that does not stick out much, like that USB SIP Memory one, allows me to leave my recovery image attached to my laptop all the time. Plus, I need something reliable for my laptop’s recovery in case I am in a remote location.
IMO I think it’s probably acceptable to run TrueNAS from a flash drive as long as you don’t have swap enabled to it, and your system dataset lives elsewhere. though I would strongly recommend mirroring as small SSDs and flashdrives alike are cheap in price and in quality.
aside from that, you can use something like this this (what I am using), this, or this. which will get you a way of having a boot mirror without having to sacrafice the main bays of your system. especially if your system has pcie brackets without pcie interfaces, typically those meant for double-high GPUs where only one of the slots has a pcie interface, which would otherwise go wasted.
They also make adapters that let you use a 2.5 SSD in a laptop-style optical bay, if you are on a rackmount server this might be of use.
there is also a hotswap version of this idea though it’s expensive.
I do kind of wish there was a dual M.2 SATA to laptop optical bay though… there are singles (mostly just recycling the design of the SATA adapters) but alas…
there are also USB MSATA boards that can usually act as a drop in replacement for a flash drive. do be sure to pick one that has the ASM1153E and not the ASM1153 (pin compatible but only the E is 6Gbps, it’s a common tactic for manufacture quality fade). they do support TRIM via UASP which is a nice touch.
