Hi all, yes, its another NVIDIA issue. I’ve had truenas scale 25.10.04 running with a gt730 card without issue and as I want to run paperless-ngx I installed it and boy was it slow with the ocr…. After asking a few questions on a handful of llm’s I was recommended to fit an Nvidia RTX 3060 12gb ram card to speed things up considerably. This I have done and the machine still boots and runs but no improvement in speed. As my Linux knowledge is basic to say the least I went and asked grok to see what I had done wrong. After entering commands suggested it appears that there are no drivers loaded for the card. Grok then said to pop over to the apps and find either nvidia or gpu to add the drivers. there are none. It suggested adding the drivers using the shell but that is locked down so you cannot add the drivers manually.
At this point I’m stuck with a machine that works and has a fairly pricey gfx card in it doing nothing. The card is working fine as I swapped it with another 3060 from one of my windows machines and it did its thing on benchmarks no problem.
To give some info on the machine. its dual xeon, 56 cores with 64Gb ram, the gt730 and the 3060 gfx cards, two drive pools of 4 drives which are working fine. Version of True Nas Scale is 25.10.4.
Any help getting this card running would be fantastic.
You can’t run the drivers for both those NVIDIA cards at the same time on TrueNAS. You should be able to pass through a card to a VM and install the driver there. See first post and discussion on NVIDIA and drivers.
ok, so running a vm to use the gpu to speed up the ocr is a thing? When I remove the gt730 the 3060 does not output any video, using the web interface says there are no drivers loaded for the 3060. Its like it doesnt exist in the machine but it really is there! I think my issue is that trunas was installed without an nvidia card active and working, just the 730 in vga mode with nothing but a generic driver used at install. after the install there has actually been no need for the 730 as I run the machine headless. I wondered about conflicts so I removed the 730 and nothing changed still no video output on any output on the 3060, either dp or hdmi.
So, the solution is to run a vm. any operating system in particular?
If you are using the 3060 as a replacement, you should be able to get it working normally. You will need to read through that thread and try to diagnose what video card or cards is showing in your system and what driver is getting loaded. You may also have to unselect them from any applications before changing video cards.
You are checking to make sure the card is seen by the hardware and then trying to sort out the driver and make sure it loads the correct one. There are some versions of NVIDIA cards that are not working with the new drivers yet. (check for 5060 issues on forum) It may work once TrueNAS 26 is released with newer drivers. lspci | grep NVIDIA should show if the card is seen by hardware. sudo nvidia-smi should show driver info, if the system loaded one.
I read through that thread and it did give me some info. I will admit to finding that I had not set the load nvidia drivers check in the main config settings… after setting that, restarting it failed to recognise the 3060 because the 730 was confusing the matter. Removing the 730 has enabled the 3060, can now use it in ollama and my issues seem to be cured. Thank you for pointing me at that thread which gave me enough info to sort things out.
No doubt I will have to learn to read more carefully and search better for things without asking stupid questions. Thank you again @SmallBarky for the pointer.
