Before buying all the components, I have some questions:
Question #1:
On the website of supermicro is mentioned that the mainboard supports DDR5-4400 MHZ. However, in the build are RAMs used with 4800MT/S. Could these differences (4400 vs 4800) make any compatibility issues?
Question #2:
This will be my first mainboard / cpu combination with IPMI support and no graphical unit. Is my understandig correct that I will be able to connect the IPMI-Lan port to my local network and install TrueNas Scale remotely via my desktop-pc (without adding any graphics card to the build)?
Question #3:
The define 7 XL case is a hugh one. There should be enough space available in the case for a non “low-height” cpu cooler too (aka a bigger one)? Maybe the size constraint comes from the mainboard?
Question #4:
If @Technoholic is reading this post, I would be interested if he is happy with the build or if he would do anything differently with the experience of using it.
Faster memory should be able to operate just fine at lower speeds.
Yes. The only trick is to determine what IP address is used by the system. This can sometimes be managed by looking at your routers DHCP table, or there are apps that can scan your network for IPMI devices.
Have you verified that it matches your requirements?
The CPU is way more than you need for a NAS. It is even bigger than the one in my VM server, which has 256 GB of RAM. And I am not running a home lab on it but my business. With 32 GB of RAM you can hardly run enough VM workload to saturate that CPU. And for storage the disks are the limiting factor.
Did you look into used servers? They are usually really cheap and provide much better for money.
Yes. But a D12L is already not “small” and bigger coolers would be massive overkill for a 95 W TDP part.
The case can potentially accomodate (at the cost of extra trays!) more drives than your PSU could manage. And, in my own experience with a Define 7 (not XL), swapping the case to “storage mode” is not pleasant; the trays are excessively fiddly, and involve too many screws.
What’s your use case? How many drives do you need, or think you’ll need?
What did you found interesting in this particular build?
(It’s not necessarily bad, but the hardware is arguably too new and too powerful for NAS use, and Xeon E-2400 are a huge regression over the previous generations in that they now lack the iGPU. If neither transcoding nor graphical VMs are required, then an iGPU is not needed but you also have many more options than Xeon E.)
I will do it this way, by looking up the router tables.
I didn’t know that - good point!
My use case is a “good allround-nas” with 1-2 VMs, some docker and data hoarding. Thanks for pointing out the over-performance of the cpu. I will look into cheaper alternatives and add more RAM instead.
Okay, thx!
Yeah, I come to the conclusion that this build is more powerful than I really need. The lacking iGPU is a good point (I don’t really need that, but it would be a “nice to have”).
Ricky1979,
Hi and thanks for the interest in my TrueNAS build. To answer your questions: #1
when this system was built, ECC DDR5 memory was not widely available so the 4800 memory was chosen due to availability. There have been no compatibility issues. #2
In theory that install method is possible but I have no first hand experience. #3
While the Define 7XL case is indeed big enough for most every hardware configuration, there are thermal challenges. I wound up adding some internal baffles, removing the front door and reversing airflow direction on top fans to blow outward. Six WD Red HDDs now run in the 32 - 36C degree range. #4
Hi that’s me and yes I am pretty happy with the build. A do-over would have me looking a while longer at chassis options. I might add that the Xeon CPU is, for me, not overkill. This is a Plex server and transcoding operations will max it out.
That was true for sure, I recall that. However, it’s a one time task. Unless you get rid of it one day and you haveto put it back into the original state. Which more than doubles the fun.
The case was not great on temps. The Fractal meshify are much cooler.
I don’t miss iGpu at all. My Emby clients mostly use Infuse, and infuse never requires transcoding. I don’t want to software encode with Handbrake, etc.
@Technoholic: Thank you for your feedback on your own build.
After investing some more hours of research, I think I will pretty much stay with your original build, but with a less performant cpu. Currently my favorite is the Intel Xeon E-2436 with 6 cores, instead of your 8 cores. The 6 cores also just need 65 watts.
I was thinking about my use cases regarding the lack of a GPU.
My understanding is that if I run docker containers with a web interface (which I will access from the remote pc), I don’t need a GPU on the nas system. I don’t need to run a full blown linux-VM with a GUI on the nas. So I think I can skip the GPU and go forward with the Xeon E-2400 series (which don’t have iGPUs). If my understanding is wrong, I am happy for feedback.
Regarding the thermal / temps challanges with the Define 7XL case: My constraint is that I need a case with 16 harddisks, therefore the Define 7XL got my attention.
However, I was thinking about a plan to improve the cooling issue. I will remove the front door, like @Technoholic already mentioned.
My plan is to install 4x Noctua NF-A12x25 PWM fans on the front, 1x Noctua NF-A14x25 G2 PWM at the back of the case and 1x Noctua NF-A14x25 G2 PWM at the top of the case. The front fans should blow air inside the case and the back / top fans should blow the air out. I hope I will get some acceptable temps with this setup.
Use case: data grave with 16 harddisks, 1-2 VMs (sometimes), 1-2 docker containers (sometimes, to try stuff out). I can also skip using VMs totally and just use docker (which I prefer).
I found this build interesting because of:
-) i want to have “server-grad” hardware, no consumer stuff
-) the supermicro X13SCL-F offeres enough upgrade capability to add a 10 gb NIC and a HBA card.
-) a “proofen” build with TrueNas. Therefore, I was searching the signatures of forum members. I didn’t want to buy parts and afterwards I find out some compatibility issues.
Fair enough. The hard part is fitting 16 HDDs in a consumer case.
As for the internals, they are certainly decent (except the PSU for 16 HDDs, bump it to 850-1000 W). You may alternatively look into the previous generations (with DDR4… and possibly an iGPU), but I’m unsure if these would provide significant savings.
Or server Ryzen boards, though these are less “proven” here for the simple reason that they are still a relative novelty. Hopefully a few years from now, EPYC 4000 will be a valid and validated alternative to Xeon E.
I have a Define 7 XL with 10 HDD, it is trivial to fit 16 in.
I also found that using the vented top with fans set to exhaust, not intake, was the best way to keep the HDD cool.
I’m using a Noctua NH-U14S, which is frankly massive, and it fits in fine. The fan control is not straightforward though, you will need to use some editing via IPMI but it’s not that challenging. The case has a good fan splitter though, so there is a lot of control between the two.
It’s probably worth pointing out that the case comes with three fans but you will need all of them just to cover the HDD, so you will need at least another three (two top, one rear).
You will definitely need to get a larger PSU. I’m using a Corsair ShiftX 1200, which I can recommend for one reason: the power cables are so much easier to manage; no comment on efficiency or safety. However, with 16 HDD you will really want at least 5 power cables just for the HDD, better to have 6 because of the risk of excess power draw on spin up (although I’ve found that TrueNAS scale spins up the HDD sequentially so there is less of an issue here. Still, I wouldn’t want to run the risk given the cost of this equipment. Even the PX850 doesn’t have enough power sockets to do that (also need one power socket just for the fans).
I’ll also point out that it is very easy to go absolute overkill…but if you want to use 16 HDD you are going to need a HBA (that motherboard only has 8 SATA ports), which mostly seem to use x8 slots, and that motherboard only has a single x8 slot, and a x8 in an x16 which would be blocked if you put the HBA in the actual x8 slot. You could easily put the HBA in x8 slot which is only x4 electrically which would probably be absolutely fine; 8 HDD shouldn’t be a problem (might be a problem if SSD though). This might get complicated and tight (HBA would need a 40mm fan strapping to it to not overheat) if you also want to add a graphics card in the future for transcoding/AI
Thx for the recommendation. Yes, I will have to upgrade the PSU. However, I have already seen some posts and reddit comments about the Seasonic Vertex PX-1000 PSU. It’s platinum instead of gold, supports up to 18 sata connections and has a 12-year warranty.
Should be fine, if I just add the HBA and NIC card. But yes, if I would like to add more cards, like graphics, this could be a problem for the future. But no plan to do so.
Good point - will check out a fan.
It will be HDD only. There will be just one SSD in the M2 slot as boot disk.
No, that is the TDP. For any normal use-case it is pretty irrelevant. The effective power consumption will be determined by the workload. Unless it is 100% all the time, it will be considerably less.
The TDP was roughly equal to power consumption before Ivy/Sandy Bridge. So those times are gone for at least 12 years.
Yes it is possible to order more power cables (usually, anyway, stock fluctuates).
It’s not about the total wattage of a PSU though, but the amount of power that can be delivered on the specific power rails. The main issue is around motor start up which is when the majority of power gets used, and it’s possible to overload a PSU if not careful. It’s not about the brand.
