Latest Nvidia drivers

TrueNAS General
, ,
1

When can I expect TrueNAS to add the latest drivers for 5 series cards? I was excited to be able to get my hands on a GTX 5060 TI 16 GB because it actually fits in my server case (the server rack has limited room). Didn’t occur to me that I couldn’t select which Nvidia Driver to install with TrueNAS. Right now I am on 25.04, and when I check the logs for nvidia:

grep -i nvidia /var/log/messages

I see the following output:

NVRM: NVIDIA 550.142 driver release.
NVRM: Please see 'Appendix A - Supported NVIDIA GPU Products'
NVRM: specific graphics driver download page at www.nvidia.com.
May 19 17:31:49 truenas kernel: NVRM: The NVIDIA probe routine failed for 1 device(s).
May 19 17:31:49 truenas kernel: NVRM: None of the NVIDIA devices were initialized.
May 19 17:31:49 truenas kernel: nvidia-nvlink: Unregistered Nvlink Core, major device number 23

In the meantime, I’ll throw it in my Gaming PC, but I’m curious as Nvidia Driver 550.142 is from December. Worried it will be quite some time before this is available…

2

Man folks complaining that older cards don’t work with current drivers - now folks complaining that newer cards don’t work with current drivers. Just can’t win :frowning:

Jokes aside - the bad news is that the latest ‘coming soon’ update also doesn’t yet have a driver that’ll support the 5000 series:

image
image1031×560 29.3 KB

image
image1920×821 125 KB

Consider making a request post on ‘Feature Request’ category I guess to let Devs know there is demand.

1 Like
3

True, can’t make everyone happy LOL.

Honestly new to TrueNAS and am enjoying it as my NFS for my k8s cluster. Finally got that working, and just happen to stumble upon Nvidia 5060 being available which fits in my server case so thought I would do a NAS/AI server combo. However, no worries since I see its not something for the foreseeable future. Finally convinced me to make my gaming desktop dual purpose!

4

Usually the nvidia drivers get updated with major releases, so twice a year. Once in april and once in october. Maybe, if there’s a bigger problem with the driver, they’ll throw in an update in a point release to fix issues.

5

Is there not a way to do this manually and download the drivers from NVIDIA?

I can download them manually, but am not able to install them from the shell…

Latest is: NVIDIA-Linux-x86_64-570.153.02.run

Roy

6

Nope not supported and or recommend. Some Middleware API calls could reference the specific driver version and may break if you update manually.

1 Like
7

Guess I wait yet ANOTHER 6 months to try switching my NAS over to TrueNAS. This time I really thought I could replace Proxmox for VMs and APPS.

8

Back to Proxmox and a virtualized NAS.

9

A thought… If I isolate the GPU in TrueNAS (its a secondary GPU) can I pass it through to a VM directly (instead on LXC)? I only need it for Ollama. I’ll let Plex use the iGPU on the CPU.

10

You have to pass through the host driver to the lxc in incus, you’d have to use a vm not an lxc

11

I found a temporary solution.
For my case, I installed TrueNAS 25.04.1 bare metal with 1 PCIE Slot for my 5060 TI and 1 PCIE Slot for my HBA, the mainboard is TUF Gaming B550m Plus Wifi.

Step 1: Make sure these settings:
BIOS:

  • Above 4G decoding = Enabled
  • IOMMU = Enabled
  • CSM = Disabled
  • Resizable BAR = Disabled, It work for me but you can try enable it
    TrueNAS GUI
  • Uncheck Apps → Configuration → Settings → Install NVIDIA Drivers

Step 2: SSH to root user

ssh root@truenas.local

Step 3: Install Latest NVIDIA Driver

install-dev-tools
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/570.153.02/NVIDIA-Linux-x86_64-570.153.02.run
mount -o remount,exec /tmp
sh ./NVIDIA-Linux-x86_64-570.153.02.run

Step 4: Install NVIDIA Container Toolkit

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
  && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
    sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
    sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
apt-get update
apt-get install -y nvidia-container-toolkit

Step 5: Install CUDA

wget https://developer.download.nvidia.com/compute/cuda/12.9.0/local_installers/cuda_12.9.0_575.51.03_linux.run
mount -o remount,exec /tmp
sh cuda_12.9.0_575.51.03_linux.run

Step 6: Help Apps Choose The GPU
I don’t know why, my TrueNAS Web Interface show the option to choose RTX 5060 TI but it shows error when I press save so I have to do this:

nvidia-smi --query-gpu=pci.bus_id,gpu_uuid --format=csv

Get the PCI BUS ID and GPU UUID

midclt call -j app.update 'APP-NAME' '{"values": {"resources": {"gpus": {"use_all_gpus": false, "nvidia_gpu_selection": {"PCI-BUS-ID": {"use_gpu": true, "uuid": "GPU-UUID"}}}}}}'

App name can be jellyfin, immich, ollama,… or any apps that you need to pass the GPU through.
After the app restart, go to TrueNAS Web Interface then Edit App and choose the unknown GPU then save.

1 Like
12

Are you doing these commands on the truenas shell directly or in a VM? Maybe I missed it, but it isn’t super clear to me.

If you are doing this in truenas, it should block the apt-get commands as installing packages through the shell is not supported or recommended.

This is pretty much what Lars was mentioning.

Imo it isn’t worth breaking the software and possibly losing data just to not run this in a VM.

If you are doing this in a VM then my bad. Everything I said above can just be for someone else who isn’t yet aware.

13
  • If TrueNAS have update, it will wipe out these additional drivers, it will also remove Developer Mode.
  • Yes I ran these commands on the truenas shell directly.
  • I mentioned install-dev-tools in Step 3 which will turn Truenas into Developer Mode.
  • Yes I risk my data.

I think now you understand my POV. I just want to make use of my new GPU.
Hope that TrueNAS major update in October will natively support 5060 Ti.

14

I’m slightly envious. I just put in my 1080 card into my TrueNAS server to help with Transcoding in Plex and got myself a 5060 card for encoding purposes on my secondary computer. The 1080 was considered one of the fastest GPUs when it was released in 2016, and now the 5060 is even faster than that GPU.

The problem is that the Linux drivers for the nVidia cards is the 550.142 released on Tuesday, Decembers 17, 2024 which was included in the release of TrueNAS 25.04 in late April, and none of the 50xx cards are supported for the time being. In fact, the release of the 5060 card occurred after the release of TrueNAS 25.04.

15

Hello everyone,

I am facing a challenge when trying to install NVIDIA drivers (versions 57x.xx) for an RTX 5060 Ti GPU on my TrueNAS SCALE 25.04.1 server. The default driver (550.142) is not compatible with the card, resulting in the error “NVIDIA-SMI has failed because it couldn’t communicate with the NVIDIA driver.”

When trying to manually install the NVIDIA .run file, I am encountering the persistent error “ERROR: Temporary directory /tmp is not executable - use the --tmpdir option to specify a different one.”

I have tried:

Using --tmpdir with /var/tmp and a ZFS dataset (/mnt/server/temporary/nvidia-tmp).
Setting the TMPDIR environment variable for the root session.
Using the --extract-only option.

The problem seems to be that the .run installer tries to use /tmp for its initial self-extraction, and TrueNAS SCALE’s /tmp is read-only and noexec. This prevents it from running, even with --tmpdir or TMPDIR set. tar -xf also didn’t work.

I suspect the filesystem is mounted with noexec, preventing it from running. I tried moving it to /mnt/data, where it normally has execute permission, but the error persists. Has anyone been able to install this specific driver on TrueNAS 25.04? Any reliable workaround tips?

Thanks!

16

You can’t update drivers yourself. The next driver update will be in October with the next major release

17

I get the OP’s feeling. If I just got the keys to a Porsche and the local racetrack didn’t open for 6 months I’d probably find a nice highway instead.

Couldn’t imagine dropping 2k on a GPU only to have the server say “who dis”. But bleeding edge isn’t where we live. I have a retired 3070ti I may use for transcoding but maybe not…next to another retired 1080. I used to keep up with the rat race until scalpers and shortages and insane prices. I’d rather drop that money on storage at this point.

2 Likes
18

Thank you for your response and the context about TrueNAS’s driver update schedule. I deeply appreciate the hard work of the TrueNAS team in building a stable and reliable system—I understand that maintaining system integrity requires careful planning and adherence to release timelines.

That said, I’m facing a genuine dilemma:

  • The RTX 5060 Ti represents a significant financial investment
  • My workflows (video rendering/AI tasks) require immediate GPU utilization to meet project deadlines
  • I’m committed to TrueNAS as my long-term solution, which is why I sought community help

Would there be any temporary workaround that wouldn’t compromise system stability? Perhaps:
➤ Test builds of the 575.57.08 driver
➤ Manual DKMS compilation instructions
➤ GPU passthrough to a container

I’m happy to test solutions, provide logs, or contribute to documentation. Thank you for considering this urgent edge case—I truly value both the system’s integrity and your team’s expertise.

Warm regards,

19

I’m in no way affiliated with iX-Systems, i’m a user like yourself.
You could try to enable developer mode, which removes the R/O status of the system and you may then be able to update the driver manually. But be aware that you’d put the stability of the sytem at risk in doing so.
You could try to use the nightly of the 25.10 release, but at this stage i would guess it’s not stable enough to use in production.

20

I would not suggest attempting this on a production system at this stage in the development cycle. I’m also not sure the nvidia driver version in 25.10 nightly builds has even been updated yet.

1 Like