GPU shows up in the device list, but can't be accessed

Apps and Virtualization
1

I have just installed a geforce 5060ti in my truenas system (25.10.3.1 - Goldeye). I installed the nvidia drivers in the apps settings. When I install Ollama with the GPU I get the following error: [EFAULT] Failed 'up' action for 'ollama' app. Please check /var/log/app_lifecycle.log for more details

When I look at app_lifecycle.log I see the following:

[2026/05/28 20:34:26] (ERROR) app_lifecycle.compose_action():58 - Failed 'up' action for 'ollama' app:  Network ix-ollama_default  Creating
Network ix-ollama_default  Created\n Container ix-ollama-ollama-1  Creating
Container ix-ollama-ollama-1  Created\n Container ix-ollama-ollama-1  Starting
Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: could not apply required modification to OCI specification: error modifying OCI spec: failed to create the automatic CDI modifier: failed to generate CDI spec for mode "auto": failed to construct device spec generators: failed to get device handle from UUID: Not Found: unknown

So it seems it can’t use it. When searching for this problem they suggested to run: midclt call app.gpu_choices | jq I get the following output:

{
  "0000:01:00.0": {
    "vendor": "NVIDIA",
    "description": "NVIDIA GeForce RTX 5060 Ti",
    "error": null,
    "vendor_specific_config": {
      "uuid": "GPU-c5144f17-54fd-a573-d767-ab144aad2d25"
    },
    "gpu_details": {
      "addr": {
        "pci_slot": "0000:01:00.0",
        "domain": "0000",
        "bus": "01",
        "slot": "00"
      },
      "description": "NVIDIA Corporation VGA compatible controller",
      "devices": [
        {
          "pci_id": "1022:1632",
          "pci_slot": "0000:00:01.0",
          "vm_pci_slot": "pci_0000_00_01_0"
        },
        {
          "pci_id": "10DE:2D04",
          "pci_slot": "0000:01:00.0",
          "vm_pci_slot": "pci_0000_01_00_0"
        },
        {
          "pci_id": "1022:1633",
          "pci_slot": "0000:00:01.1",
          "vm_pci_slot": "pci_0000_00_01_1"
        },
        {
          "pci_id": "10DE:22EB",
          "pci_slot": "0000:01:00.1",
          "vm_pci_slot": "pci_0000_01_00_1"
        }
      ],
      "vendor": "NVIDIA",
      "uses_system_critical_devices": true,
      "critical_reason": "Devices sharing memory management: Renoir PCIe Dummy Host Bridge (0000:00:01.0)",
      "available_to_host": true
    },
    "pci_slot": "0000:01:00.0"
  }
}

lspci |grep NVIDIA results in the following:

01:00.0 VGA compatible controller: NVIDIA Corporation Device 2d04 (rev a1)
01:00.1 Audio device: NVIDIA Corporation Device 22eb (rev a1)

so it seems it find the 5060ti, but when i run nvidia-smi

No devices were found

Does anyone have any idea why it all seems that the card works properly, but when I want to access it, it doesn’t seem to be working?

Ow, I do get video output from the card to my screen, so the basic functionality seems to be working.

2

There’s a version of 5050 and 5060 cards which apparently have a newer version of the GPU chip and need a newer version of Nvidia driver then the one true as uses…