Support amd APU NPU's

Problem/Justification
Basic AMD NPU is already in but needs updates to firmware and driver to latest to support using the NPU in things like Fastflow LLM.
Latest firmware and drivers are available but need to be incldued in the kernel before they can be used. Current drivers are outdated.

Impact
This will enable NPU use for local LLM and other AI workloads

User Story

Users can offload AI tasks and enable LLM Processing for very low energy use to the NPU in APU based systems.

1 Like

What kernel is needed? There is a good chance the newer kernel in TrueNAS 26 will support it.

The included kernel for 26 is new enough and supported.

It’s just that the included driver and firmware for the NPU are too old.

26 is based on relatively recent Debian 13. What version if firmware is required for the NPU support?

Then you are looking for the next version after TrueNAS 26, if the driver and firmware are considered stable.

Afaik firmware needs to be 1.1.0.0. there’s currently a 1.0.x.x included.

Also, a fairly recent version of amd amdxdna is required.

I’ll toss a vote - I’m not against it, though I think this’ll be one of those “wait long enough & it’ll happen” regardless of the feature request or not :frowning:

Edit; don’t forget to vote for your own feature request!

1 Like

It would be nice if you instead stated on what date that firmware was updated, linux firmware is usually versioned using the date.

Sorry, Didn’t know that. This version is literally the one I have and afaik it’s the latest from AMD and it’s the one mentioned as a requirement in the amd documentation for lemonade.

Kernel should be 6.17 or higher so the 6.18 in truenas 26 should be fine. Just needs the amdxdna-dkms driver on board.

Just adding an extra note here.
amdxdna minimum version is 0.7
A new firmware file from AMD is released: 1.1.2.64 (npu.sbin.1.1.2.64.zst)

Any easy way to get this updated on my truenas 26 install?

There’s no official way to update/intsall drivers yourself. Driver gets included/updated when ever truenas gets an update (espacially if it’s a driver that’s build into the kernel). The kernel only gets updates with major truenas versions. So the next kernel update will be with truenas 26 in Q3/4 this year.

Looks like 26.0.0-BETA.2 also doesn’t have this upgrade?

root@truenas[~]# cat /sys/bus/pci/drivers/amdxdna/*/fw_version
1.0.0.63
root@truenas[~]#

Am I reading this right?

You might be stuck waiting for next years version of TrueNAS 27 to see an update. TrueNAS is conservative on what is updated.
There is still an expected 26 Release Candidate and the 26 Release expected later this year but I expect they are just working on stability and bug fixes going foreward on the 26 series.

Correct! However, working with someone in the Minisforum discord we were able to use sysext to overlay new files with the correct drivers and get the NPU working with Truenas.
We had to compile the driver ourselves for the 6.18 kernel.

This is a ready made bundle that worked for me some time ago. I’ve since changed my setup and compiled my own version. But it might still work.