I’m running Goldeye 25.10.0.1 and recently installed an RTX 5060 TI (16GB) GPU for the purpose of passing it through to an Ubuntu VM for use in running llm models. However, Goldeye does not fully recognize it. It shows (from lspci) as “VGA compatible controller: NVIDIA Corporation Device 2d04 (rev a1).” It’s my understanding that this is the generic designation for an NVIDIA GPU. This doesn’t allow me to run llms because ollama requires the specific driver for the 5060.
I frankly don’t know much about GPUs. I’m not a gamer and have never owned a GPU until yesterday. It’s my understanding, however, that since the 5060 is somewhat new, it wasn’t supported in Truenas until Goldeye but that, at least from what I saw online, it’s supposed to be supported in Goldeye without having to install a driver manually, although maybe I’m wrong about this.
Does anyone know why Goldeye isn’t properly recognizing an RTX 5060 TI Nvidia GPU?
fyi the exact model of the GPU is Gigabyte Windforce RTX 5060 TI 16GB. The CPU is a Ryzen 5 5650G, and the motherboard is Asrock Rack x570d4u, with 46 GB ECC Ram.
“When using a VM only the guest OS needs to have the driver. Not the host.”
Thanks. I didn’t know that. I’m also having trouble getting the GPU properly recognized in the guest, but that’s not an issue for Truenas or this forum. I will work on it separately. I had assumed that it needed to have the proper driver in the host also, but if not, then I won’t worry about it in the host.
My 5060 “seemed” to work with the latest drivers installed on the guest. But trying to check the driver with nvidia-smi resulted in not only a locked up VM, it also locked up TrueNAS. The only thing I have had any success with has been checking the box to install the Nvidia drivers in the host. Then running an LLM docker image. I’m not sure if there are tweaks in TrueNAS or the BIOS that might improve the VM situation.
After much trying, I was unable to get the 5060 working in the guest, and I never got it recognized in the Truenas host. I gave up, yanked the card, and installed it bare metal in another build I had sitting around. Even then, getting it to work in Ubuntu bare metal was difficult, but I eventually managed to do so in the latest version of Ubuntu, 25.10, by installing a driver with the command “sudo apt install nvidia-driver-570-open,” then a reboot.
I suspect that this same command might work in Truenas from the shell since it’s all Debian, but I have a policy of not making changes in Truenas outside of the UI since they could break Truenas and, in any case, might not stick after upgrades.
Docker, as you suggest, could be another possibility, but I don’t have much experience with that.
Truenas uses driver version 570.172.08 which should work… and for apt to work in truenas you’d have to enable developer mode and might break the truenas middleware because it might rely on the specific driver version in it’s api calls…
Hi Don’t know if you got it working or not but I was having the same problems just about gave up and went to go to my bios but being MSI was finding it hard to get into it, anyway long story short, i connected my monitor and used the 5060ti as the screen monitor output rather than the inbuilt gfx and now ollama just recognizes it and uses it. may have just been luck but hope it helps.
