first of all, I am relatively new to TrueNAS. I have a few years of general Linux experience, but please excuse me if I get things wrong.
I just got a good deal on a 16GB 5060 Ti. I already know that I probably won’t be able to get it to run with 25.04, so I tried the 25.10 nightly build.
After checking the box for installing NVDIA drivers, the card shows up for use in Apps and I was able to select it for Ollama.
However, when I try nvidia-smi in the TrueNAS as well as in the Ollama app shell, the command returns “no devices were found” (and I am pretty sure that the card does nothing when I used a test workload in Ollama).
Checking var/log/messages, everytime I use nvidia-smi, a line with “NRVM: The NVIDIA GPU installed in this system requires use of the NVIDIA open kernel modules.” appears.
The solution there is to install the 570 MIT/GPL driver. I understand this would not be an easy thing to realize in TrueNAS. Is there anything I can try in the short term or would it be most feasible to just wait for the October release of 25.10?
Thanks for the reply (replies :)), I wasn’t aware that isolating an unsupported GPU was possible. I’ll try that. Indeed I am just testing stuff right now, hence I am using a nightly build.
I am looking to replace an aging Synology NAS - I have already settled on a bunch of used server hardware, and now I am trying to evaluate what I can do with TrueNAS/other software. And one of my hopefully sometime productive use cases is LLM-based OCR for paperless-ngx with paperless-gpt and Ollama (e.g. for barely readable receipts).
@Chomp Thanks for the heads up. What’s the exact nightly build of TrueNAS you’re using? We just bumped from 570.153.02 to 570.172.08 to try to catch the vanilla 5060 support, so I want to see which driver this is on.
I recently upgraded to 25.04.2. I added a 5060Ti to my system as I saw the driver had been updated to 550.153.02 which supports it. However, when checking /var/log/messages, I still see it trying to use the 550.142 driver. Is that a similar issue to what he’s seeing with 25.10?
You are just a victim of bad timing with your purchase/install of that 5060Ti card in your TrueNAS server.
Per the 25.04 (Fangtooth) Version Notes, the version of the nVidia drives that is used by TrueNAS is 550.153.02 which were released in December, 2024. This is prior to the release of the entire nVidia 50xx series of cards.
When I run the command nvidia-smi, I see the following:
root@vaultron[~]# nvidia-smi
Fri Aug 1 19:00:06 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.142 Driver Version: 550.142 CUDA Version: 12.4 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce GTX 1080 Off | 00000000:01:00.0 Off | N/A |
| 0% 38C P8 7W / 200W | 3MiB / 8192MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
I actually acquired and installed a 5060 card on my secondary computer this past May mainly for video encoding purposes and put my 1080 card into my TrueNAS server. That 1080 card will be EOL for driver support in about three years.
