HDD passthrough issues

Hey all,
I recently posted an issue at Proxmox forums (Hard drive passthrough issues | Proxmox Support Forum) regarding an issue with hard drive passthrough.

To make it a little shorter, I will try to summarize:
HW:
Dell PE R740xd with HBA330
2 x Kingston SSD DC600M 960Gb. For Proxmox boot and 2 VMs (Windows Server and TrueNAS)
9 x WD HC330 10TB. Just Storage.
160 GB ECC Ram.

The thing is, I wanted to passthrough the drives to TrueNAS, and so I did, and I can see the drives in TN:

The issue is that trying to do a SMART test I get this message:

Given what I’ve found, this sounds like I should do the passthrough of the whole HBA330, not the drives-by-id, which is an issue because those Kingston SSDs are too connected to the HBA through the server backplane, so I cannot “unplug” them.

So, if I do the whole passthrough, I cannot use the SSDs for booting and I want to have redudant boot volume. I could use one of those nvme carrier cards, but read that this server can be picky with other types of booting (else I should find a BOSS card but that is an issue at this time).

If I want to have redundant boot, and I cannot to a disk-by-disk passthrough, then it seems that my only choice is go bare-metal, which is really not my first option as I believe that bare-metal is a waste of resources, and because I would be using the DC600M drives as TN boot, which is like using Formula 1 tyres in a bicycle, but at least that would allow to go on with the project.

To summarize my options

  • Do the disk-by-id passthrough, but loose the smart data at TN level
  • Go bare metal and use the SSDs as mirrored boot.

Feel free to add more options and corrections.

Now that I think about it, a BOSS card would be of no use for a Proxmox install as I would have to pass the whole HBA, loosing the access for the SSDs to use them for VMs.

Thank you!

EDIT: Updated screenshot

In order to safely use TN under ProxMox you have to:

  1. Pass through the entire controller
  2. Blacklist the controller on proxmox
    When I say “Have to”, I mean that if you don’t then history says that at some point it will all go FUBAR and your pool will get corrupted. This normally happens when proxmox tries to (in some manner) import the pool

Which I guess answers your question - go bare metal

4 Likes

Oh boy :frowning: <face_palm>

Thank you.