Support amd APU NPU's

Problem/Justification
Basic AMD NPU is already in but needs updates to firmware and driver to latest to support using the NPU in things like Fastflow LLM.
Latest firmware and drivers are available but need to be incldued in the kernel before they can be used. Current drivers are outdated.

Impact
This will enable NPU use for local LLM and other AI workloads

User Story

Users can offload AI tasks and enable LLM Processing for very low energy use to the NPU in APU based systems.

What kernel is needed? There is a good chance the newer kernel in TrueNAS 26 will support it.

The included kernel for 26 is new enough and supported.

It’s just that the included driver and firmware for the NPU are too old.

26 is based on relatively recent Debian 13. What version if firmware is required for the NPU support?

Then you are looking for the next version after TrueNAS 26, if the driver and firmware are considered stable.

Afaik firmware needs to be 1.1.0.0. there’s currently a 1.0.x.x included.

Also, a fairly recent version of amd amdxdna is required.

I’ll toss a vote - I’m not against it, though I think this’ll be one of those “wait long enough & it’ll happen” regardless of the feature request or not :frowning:

Edit; don’t forget to vote for your own feature request!

1 Like

It would be nice if you instead stated on what date that firmware was updated, linux firmware is usually versioned using the date.

Sorry, Didn’t know that. This version is literally the one I have and afaik it’s the latest from AMD and it’s the one mentioned as a requirement in the amd documentation for lemonade.

Kernel should be 6.17 or higher so the 6.18 in truenas 26 should be fine. Just needs the amdxdna-dkms driver on board.

Just adding an extra note here.
amdxdna minimum version is 0.7
A new firmware file from AMD is released: 1.1.2.64 (npu.sbin.1.1.2.64.zst)

Any easy way to get this updated on my truenas 26 install?

There’s no official way to update/intsall drivers yourself. Driver gets included/updated when ever truenas gets an update (espacially if it’s a driver that’s build into the kernel). The kernel only gets updates with major truenas versions. So the next kernel update will be with truenas 26 in Q3/4 this year.