Hi team, any help would be appreciated. Recently purchased X12STH-F with Xeon E-2356G with 64G Crucial ECC. Hopes were to passthrough the 2356’s iGPU to a windows VM but unable to get it to work. I know I’ve probably messed something up but at first I enabled onboard graphics in Bios so Truenas could see the iGPU. I also enabled IOMMU in bios as well.
Error when attempting to isolate:
[EINVAL] gpu_settings.isolated_gpu_pci_ids: 0000:00:02.0 GPU pci slot(s) consists of devices which cannot be isolated from host.
After looking at a few posts I ran this, but not sure if it survives reboots or is a source of my problem:
Can you set the aspeed vga controller as primary in the BIOS?
Also, whats the output of:
#!/bin/bash
for d in /sys/kernel/iommu_groups/*/devices/*; do
n=${d#*/iommu_groups/*}; n=${n%%/*}
printf 'IOMMU Group %s ' "$n"
lspci -nns "${d##*/}"
done
the Aspeed as far as I understand is just for IPMI. I did check bios and didn’t see any way to select that video device for primary. There is an option to select primary video as “onboard” or “offboard” but I tried selecting that last night and whoopsie, had to clear cmos to get it to boot back into bios again - it froze at boot asking for me to connect the dsub to another input.
output:
IOMMU Group 0 00:02.0 VGA compatible controller [0300]: Intel Corporation RocketLake-S [UHD Graphics] [8086:4c9a] (rev 04)
IOMMU Group 1 00:00.0 Host bridge [0600]: Intel Corporation Device [8086:4c53] (rev 01)
IOMMU Group 10 00:1b.0 PCI bridge [0604]: Intel Corporation Tiger Lake-H PCIe Root Port [8086:43c0] (rev 11)
IOMMU Group 11 00:1b.7 PCI bridge [0604]: Intel Corporation Tiger Lake-H PCIe Root Port [8086:43c7] (rev 11)
IOMMU Group 12 00:1c.0 PCI bridge [0604]: Intel Corporation Tiger Lake-H PCIe Root Port [8086:43b8] (rev 11)
IOMMU Group 13 00:1c.4 PCI bridge [0604]: Intel Corporation Tiger Lake-H PCI Express Root Port #5 [8086:43bc] (rev 11)
IOMMU Group 14 00:1c.5 PCI bridge [0604]: Intel Corporation Device [8086:43bd] (rev 11)
IOMMU Group 15 00:1d.0 PCI bridge [0604]: Intel Corporation Tiger Lake-H PCI Express Root Port #9 [8086:43b0] (rev 11)
IOMMU Group 16 00:1f.0 ISA bridge [0601]: Intel Corporation C256 LPC/eSPI Controller [8086:438d] (rev 11)
IOMMU Group 16 00:1f.4 SMBus [0c05]: Intel Corporation Tiger Lake-H SMBus Controller [8086:43a3] (rev 11)
IOMMU Group 16 00:1f.5 Serial bus controller [0c80]: Intel Corporation Tiger Lake-H SPI Controller [8086:43a4] (rev 11)
IOMMU Group 17 01:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Blue SN550 NVMe SSD [15b7:5009] (rev 01)
IOMMU Group 18 03:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 06)
IOMMU Group 18 04:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 52)
IOMMU Group 19 06:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
IOMMU Group 2 00:01.0 PCI bridge [0604]: Intel Corporation Device [8086:4c01] (rev 01)
IOMMU Group 20 07:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
IOMMU Group 21 08:00.0 Non-Volatile memory controller [0108]: Solidigm P41 Plus NVMe SSD (DRAM-less) [Echo Harbor] [025e:f1ab] (rev 03)
IOMMU Group 3 00:08.0 System peripheral [0880]: Intel Corporation Device [8086:4c11] (rev 01)
IOMMU Group 4 00:12.0 Serial controller [0700]: Intel Corporation Tiger Lake-H Integrated Sensor Hub [8086:43fc] (rev 11)
IOMMU Group 5 00:14.0 USB controller [0c03]: Intel Corporation Tiger Lake-H USB 3.2 Gen 2x1 xHCI Host Controller [8086:43ed] (rev 11)
IOMMU Group 5 00:14.2 RAM memory [0500]: Intel Corporation Tiger Lake-H Shared SRAM [8086:43ef] (rev 11)
IOMMU Group 6 00:15.0 Serial bus controller [0c80]: Intel Corporation Tiger Lake-H Serial IO I2C Controller #0 [8086:43e8] (rev 11)
IOMMU Group 6 00:15.1 Serial bus controller [0c80]: Intel Corporation Tiger Lake-H Serial IO I2C Controller #1 [8086:43e9] (rev 11)
IOMMU Group 6 00:15.3 Serial bus controller [0c80]: Intel Corporation Device [8086:43eb] (rev 11)
IOMMU Group 7 00:16.0 Communication controller [0780]: Intel Corporation Tiger Lake-H Management Engine Interface [8086:43e0] (rev 11)
IOMMU Group 7 00:16.1 Communication controller [0780]: Intel Corporation Device [8086:43e1] (rev 11)
IOMMU Group 7 00:16.4 Communication controller [0780]: Intel Corporation Device [8086:43e4] (rev 11)
IOMMU Group 8 00:17.0 SATA controller [0106]: Intel Corporation Device [8086:43d2] (rev 11)
IOMMU Group 9 00:19.0 Serial bus controller [0c80]: Intel Corporation Device [8086:43ad] (rev 11)
IOMMU Group 9 00:19.1 Serial bus controller [0c80]: Intel Corporation Device [8086:43ae] (rev 11)
Two things, I needed to check esxi for another reason so I took an opportunity to pass through the intel iGPU and it worked however after installing windows it recognized it but complained there was an error with the device under device manager (code 43). Next I moved the nvidia out of the desktop and put it into the server. Fun fact for anyone reading this, a full length Gpu blocks the powered sata ports which meant I couldn’t use my satadom for the boot drive. After booting a fresh install of electric eel I was able to isolate the nvidia with no issue. I also tried to isolate the intel iGPU as well which gave the same error I kept getting before.
Not sure where to go from here, is there something wrong with my processor?
edit I went on to create a windows VM with the nvidia and I receive this error “[EINVAL] gpu_settings.isolated_gpu_pci_ids: pci_0000_01_00_1, pci_0000_01_00_0 GPU pci slot(s) are not available or a GPU is not configured”
You wont be able to pass iGPU because Intel dont have proper drivers for Windows and wont have for that. I’am in the same boat… No more GVT-g for these processors as all went to GVT-d…
I ended up abandoning the hunt for windows VM on TrueNAS. Wasn’t a deal breaker so it was sad but not that big of an issue. I use TN with Jailmaker only, no VMs
