Mooglestiltzkin's Build Log: Truenas build recommendation am5 2024?

The sentence doesn’t quite make sense.
Mind that “Xeon” encompass many different things.
Xeon D-1500 is ultra low-power, including at idle.
Xeon E-2000 is the same as a Core consumer CPU (incl. low idle power), but with ECC.
Xeon Scalable, or Xeon D-2100, which is the embedded version, idles above 50 W.

X10SDV boards have one M.2 slot on-board and one x16 PCIe slot, or two x8 slots, which can bifurcate all the way to x4x4x4x4 so you can have up to four more drives M.2 and/or U.2 with (cheap, passive) riser cards (Asus Hyper.M2 and similar). Gen 3 only (this is Broadwell!), but that should be enough for a home server—remember that Gen4 drives work at 3.0 speed too.

Old, as pointed by @Stux, but still sold new (and with several years of warranty) because the following generations are higher power devices and do not replace these Old-Faithful. How much you’d trust a second-hand X10SDV board by now is for you to answer. I would, @Stux obviously doesn’t.

1 Like

raidowl is using the kickstarter jetkvm @ $69 for those with mobos without an ipmi.

the pcie addon card raidowl was referring to was mobo supporting

bifurcation on the pcie slot for
x16 → x8, x4, x4


which can bifurcate all the way to x4x4x4x4 so you can have up to four more drives M.2 and/or U.2 with (cheap, passive) riser cards (Asus Hyper.M2 and similar).

well i’ll have to check what pcie card does that bifurcation u mentioned.

did you mean this one?

wait what did wendel mean @ 9:40 in the video. From what i gather you can’t use the ssds on the pcie addon for raid (including software raid), unless u chip in for some additional item to make that possible? does that mean even if u get the pcie card you wont be able to make mirror raid in zfs for the 2 x m.2 nvme?

i use an addon pcie for my qnap for my 2 m.2 nvme ssds, but i don’t have this issue creating mirrors for them. that is why i’m confused by what he mentioned.

Regarding chassis,

I think 6 bays is a good minimum, as it allows you to get the storage efficiency benefits of raidz2

But 8 is great :wink:

Here is the best recent summary thread on smaller scale chassis

I think I’d lean towards the cs382, it has some fascinating features (5.25” bay, optical bay etc)

1 Like

I wouldn’t say that, but when buying a second hand mobo you can end up buying a lot of trouble.

Mobos can have very subtle failures.

Plus, in my experience, it’s almost always the mobo failure that signifies the end of a system’s life. Not the ram, cpu, psu, nic or hd failures.

I also don’t buy second hand HDs, but lots do

:thinking:

https://www.reddit.com/r/truenas/comments/15kr080/ryzen_5_build_which_one_to_go_for/

:thinking: 8500G ? has 6 core 12 threads 65 tdp, has an igpu.

1 Like

The hyper card supports 4x m.2 drives.

The other one supports 2x m.2 drives and a low profile 8x PCIe card, such as a gpu.

So for example, in an X10SDV, this allows a GPU and 3 m.2 drives.

Alternatively, an HBA… or even some of those m2 sata adapters.

1 Like

what about a sfp+ pcie card, would that also fit?

can the build do 10g networking?

i’m using sfp+ 10g fiber om3 with a switch that supports 10g sfp+

using it already for my desktop pc and my current ts-877.

will go either with a gen3 or gen4 m.2 nvme ssd using the pcie addon card

deadset on the 12tb exos x12. its probably recertified but it comes with a 5 year warranty international should be ok… good reviews… so 4 of these setup as raidz for truenas

X10SDV boards come in an SFP+ variant, eg:

I think its the “+” at the end of “TN4F+”

Whether you can actually get one is a different question.

Wasting a PCIe slot for SFP+ on a MiniITX board is not such a good idea.

Supermicro has a bunch of X10SDV board using Flex ATX which are even more capable, for example

BUT then you find yourself wondering… what’s in X11… X12 etc :wink:

Lots and lots of options. Sorry, I haven’t done further research :wink:

1 Like

I have a 2023 AM5 CPU and 2023 ASRackRock motherboard (they could actually be 2022, I’d have to look it up), and they have been extremely stable from day one, and I tested the crap out of it. BUT (it is a big but) I do not run TrueNAS on bare metal, I use ESXi. I have run it at least once for a while on bare metal but that is not my normal setup.

With that said, I did a lot of research before I purchased it. I wish I could make a small change, find a motherboard with an additional x4 PCIe connector. But that was not part of the original specs. I still don’t “need” it, but I want it to pop in a card. The x1 PCIe slot isn’t good for much.

This means that I would promote the AM5 socket however if you do not read the specs of a CPU, you can’t just buy any AM5 CPU and hope it works. This goes for any CPU actually. You need to know what your requirements are. Write them down on paper (paper is great as it is a tangible thing you hold, carry around) and let it take you a few weeks at a minimum to collect this list of requirements. Many requirements are easy, and many you don’t even think about.

What do you not think about? I think the main ones are PCIe lanes and Case Airflow. With NVMe M.2 storage becoming more common, people are paying attention to PCIe lanes.

2 Likes

this is closest to what i had in mind. u have to skip through the long intro with music lel :rofl:

this video is useful cauz im not a pro system builder. so id have to follow the step by steps. lately i changed thermal paste and cpu. but i did not add fan cooler bracket before :sweat:

i think i can do that. but one part i’m most clueless is the cabling to the psu. i’ll just find a youtube on that to refer to :sweat:

worse case scenario i send it to shop to fit it for me.

still going through the posts in thread. ty for feedback much appreciated.

https://www.reddit.com/r/hardware/comments/1ajwc3k/amd_silently_removed_ecc_support_from_ryzen_8700g/

Sorry to bust your bubble, but -PRO chips are OEM only. So they don’t sell them to regular customers. Not only that, Lenovo infamously hardware locked their PRO chips so if you try to use the chips on a different motherboard, it becomes e-waste.

:scream: well learned something new. i was wondering why it wasnt on the eseller site.

so then i’d need something like a 5600x which has ecc ram support? since the igpu solutions dont have ecc. or just do what the youtuber did, get the 8500g (non pro), with non ecc ram and not worry about it :thinking:

was looking at ddr4 ecc ram only thing i found for availability was (since nothing for ddr5 that i could find)

Server / Workstation / ECC RAM DDR4 64GB / 32GB / 16GB / 8GB 2400Mhz/2666Mhz/3200Mhz

used, but reviews say it works. so i’m guessing safe to buy? 6 month warranty only though :sweat_smile:

not sure if i should fuss over having ecc ram or not. never had a issue without it before (that i noticed :sweat_smile: )

The video from BO1, no ECC RAM.
the Motherboard is not a server quality board, it has only two RAM slots, practically no PCIe slots.
He was not prepared to shoot this video. It is sad when I know more about the motherboard that I’d never seen before.
The stock cooler is more than fine. They are actually pretty good. A long time ago they sucked, but now they are good an quiet.
I don’t like the way he used the heatsink compound, it can lead to hot spots.
OMG, and he never got it working. I was cringing when he was using a power screwdriver. I never recommend that when working on a computer. What is the torque spec for a value of “17” on his screwdriver? Unprepared and I will never get that time back while trying to watch that video.

Do not build a computer this way!

He reminds me of Robert from Everyone Loves Raymond.

Okay, I’m done with the commentary.

Bed time for this old man.

1 Like

ty joe. gnite

yeah i watched to the very end, and it couldnt boot up :sob: after all that.

probly not the parts id get, but its wendel and steve who definitely know what they r talking about. just seeing how they install the parts and what i can learn from it

this helped. i was planning to install the 2u case into rack, but if that doesn’t work out, this is a great fall back plan using this smaller metalic shelf for it, right beside the server rack.

a newer video by wendel.

this part i already know. but for the other beginners out there who need it. Jim covers it. i would also recommend lawrence channel which also does the walkthrough for truenas initial setup in UI.

If you need help setting up docker in the new eel, check out stux’s youtube channel for that.

This video is 4 years old, which is not too bad… but the good thing about it is Patrick goes through the process of evaluating and picking a platform.

1 Like

i thought patrick only did switches? oof i missed out on this. ty i will check it out.

Ryzen 5600 on a x570 MB, 2 spinning disks, 2 ssd, 32GB ECC ram. It’s drawing 40 watts at idle. Not great but it can transcode 10bit 4K without any interruption.

Gigabyte X570 Aorus Pro, NEMIX RAM 32GB (2X16GB) DDR4 3200MHZ PC4-25600 2Rx8 1.2V 288-PIN ECC

:thinking:


so x16 for graphics card

another x16 for the m.2 nvme pcie card

and a x8 for the sfp+

i was checking spec sheet but nothing fits :sob:
https://www.asrock.com/mb/index.us.asp#AM5

*update

found one that says it works on x4 though i’m not sure what the downside is


mobo this maybe?

says it does 4x sata3

1x m.2 nvme (the other 2 can install via the addoncard using the x4 pcie slot)

says it has a Integrated AMD RDNA™ 2 Graphics. the mobo has a hdmi port. does that mean this mobo does not required an igpu cpu?

only has 2 ram slots. i will only ever be using 2 slots so this doesn’t seem to be an issue for me. 2x 16gb (32gb) ram

CPU:

  • 1 x PCIe 4.0 x16 Slot (PCIE1), supports x16 mode*
  • 1 x PCIe 4.0 x16 Slot (PCIE3), supports x4 mode*
    Chipset:
  • 1 x PCIe 4.0 x1 Slot (PCIE2)*
  • 1 x M.2 Socket (Key E), supports type 2230 WiFi/BT PCIe WiFi module

CPU:

  • 1 x Blazing M.2 Socket (M2_1, Key M), supports type 2280 PCIe Gen5x4 (128 Gb/s) mode*
    Chipset:
  • 1 x Hyper M.2 Socket (M2_2, Key M), supports type 2260/2280 PCIe Gen4x4 (64 Gb/s) mode*
  • 4 x SATA3 6.0 Gb/s Connectors
  • 1 x USB 3.2 Gen2 Type-C (Front)
  • 1 x USB 3.2 Gen1 Type-C (Rear)
  • 6 x USB 3.2 Gen1 Type-A (2 Rear, 4 Front)
  • 8 x USB 2.0 (4 Rear, 4 Front)

https://www.reddit.com/r/ASRock/comments/14qpwl3/any_reason_to_consider_asrock_b650mhdvm2_instead/

B650M Pro RS is just B650M-HDV/M.2 with 4 memory slots and maybe 1 extra USB port. Thats all the difference. VRM is same on both.

but if u only use 2 memory slot then no big deal? 1 extra usb port? dont really care. also i didnt hear anyone verify ecc working on the rs. but there was verification for the otherboard :thinking:

would the B650M-HDV/M.2 have enough fan headers though for a 2u case though?

well 3 case fans based on the pic


connectors

  • 1 x SPI TPM Header
  • 1 x Power LED and Speaker Header
  • 1 x CPU Fan Connector (4-pin)*
  • x Chassis/Water Pump Fan Connectors (4-pin) (Smart Fan Speed Control)
  • 1 x 24 pin ATX Power Connector
  • 1 x 8 pin 12V Power Connector
  • 1 x Front Panel Audio Connector
  • 1 x Thunderbolt™ AIC Connector (5-pin) (Supports ASRock Thunderbolt™ 4 AIC Card)
  • 2 x USB 2.0 Headers (Support 4 USB 2.0 ports)
  • 2 x USB 3.2 Gen1 Headers (Support 4 USB 3.2 Gen1 ports)
  • 1 x Front Panel Type C USB 3.2 Gen2 Header

overal seems to do what i need it to, but major downside says it does 4x sata3 (i’m only going to be using 4x 3.5’’ inch hard drives. but if there is a matx board that can do 8 sata let me know. something like this board but support 8x sata3 drives :thinking:

ram not sure what to get

KINGSTON FURY BEAST BLACK 6000MHZ CL30 (16gb x2) *this is not ECC. I could not find ecc ddr5 to buy :cry:

the 2.5 nic not sure how good it is. but doesn’t matter since i’ll be using the 10gtek sfp+ 10g om3 fiber instead. thats what i am currently using on my desktop and nas atm (works gr8)

*update

found solution for not enough sata3 ports. there is an addon card that can do this

so instead of installing graphics card in the x16, just add this sata3 pcie card instead.

so end result would be

  • x16 = sfp+ pcie card
  • x16 = sata3 x4 port pcie card
  • x4 = 2x m.2 nvme

confused whether i need a igpu cpu or not. because it has hdmi and description Integrated AMD RDNA 2 Graphics in the specs for mobo.

https://www.reddit.com/r/pcmasterrace/comments/1b5ha47/what_is_integrated_graphics_for_in_motherboard/

if it meant id have to go for g series for that to work (tradeoff, no ecc support), im fine with that.

That’s one NVMe (x4, from PCIe slot) and one SATA (from the SATA connector next to it, to be wired to a motherboard port). Watch less videos, and read more…

AM4 is very much a possibility. The drawback is that AM4 server-grade motherboard are few and expensive (save for the Gigabyte MC12-LE0 for European buyers), and with consumer-grade motherboards you’re taking an act of faith with respect to ECC support. Most desktop Ryzen CPUs support ECC (unofficially), but for APUs only the OEM-only ‘PRO’ variants support ECC. By now, AM4 PRO APUs have made their way to retail and to eBay.

AM5 APUs (Ryzen PRO 8000G) are not released yet. But AM5 desktop CPUs (7000/9000) have an iGPU as well and generally support ECC (check specifications).

SATA is falling out of fashion. B650 is limited to 4 SATA. Previous generation B550 can support 6 SATA. For 8 SATA you have to go X470.

We generally advise against this kind of cheap SATA controller. ZFS tends to throw more workload at them than what they can cope with.

2 Likes

i gather from this i should be looking at the x470 motherboards to solve the lack of sata3 ports. ill do more research thx. at least i got a lead.

ill also look into 7/9k series whats available on that :wink: ill check what fits into my budget. if things r not good i’ll consider going am4 instead :smiling_face_with_tear: will check prices first.

*update

you were right

this one is a 65tdp cpu with 12 cores 24 threads.

or the 7600 @ 6core / 12 threads also 65w tdp.

ill check the prices. i probably dont need more than the 7600 though. both have igpu and ecc support.

*update

found a x470 but doesnt support the 7000 series cpu

im guessing i need x670 since it says 8 sata ports.

https://www.reddit.com/r/Amd/comments/v037d8/socket_am5_no_microatx_motherboards/

:sob:

the case i am looking at, can support atx mobo. but, i have to opt for the thin single power supply. the one the case seller offers is great wall brand. so do i go with that? (i read its fine as long as u dont use with a full blown graphics card) or is there one u recommend? i tried looking but could find anything. tempted to just go with this bad rep power supply since thats the only one forthcoming :cry:

then i can just go atx motherboard without worry of lacking sata ports. the matx doesn’t seem to cut it for 8sata ports :grimacing:

saw a few x670 but at most was 6 sata, not 8 :face_with_monocle:

https://www.reddit.com/r/truenas/comments/195brtt/fractal_node_804_best_motherboard_cpu_for_maximum/

:eyes:

couldnt find am5 mobo with 8 sata ports. but the am4 did and also has ecc support

it’s even a Micro ATX Form Factor, perfect.

might have to just go am4 then. i also know where to buy the ecc ram for it as well which is a bonus. what is a good cpu to pair with it though?

If 6 SATA is enough, look at B550 boards—less expensive than X470.
Add a Ryzen PRO 4650G or 4350G from eBay, and you can use DDR4 ECC UDIMM (not RDIMM!). The x16 slot can bifurcate x8x4x4 with a suitable riser for 2 M.2 and one half-eight NIC.

If you are willing to import a MC12-LE0 from Germany, you can go for, say, a Ryzen 5600(X) CPU, use the BMC video output to set the BIOS (no iGPU), still enjoy ECC UDIMM, and bifurcate the x16 slot to x4x4x4x4 for four M.2 drives. 6 SATA, the onboard M.2 (x1) to boot, and an open x4 for your SFP+ NIC (being open, the slot can accept x8 cards).

AM5 Ryzen with 8 SATA ports is not going to be a happy exercise.

However you could look into older Intel boards.
Confining myself to a genuine server board ('cause I’m a purist):
AsRockRack E3C246D4U2-2T
8 SATA
BMC for video output, and many compatible CPUs have an iGPU anyway, including the Core i3-8100/9100 which are super cheap and would work in this board with ECC UDIMM
additional M.2 from the PCIe slots (x16 → x8x4x4, same as AMD APUs)
copper 10 G on-board, and still PCIe slot option for SFP+

If you’re going for a rackmount chassis and worry about cooling, you’d want a server board so that components are properly placed. Notice that server boards have their RAM slots turned 90° compared with consumer boards: This makes for good front-to back airflow.

1 Like