Problem/Justification
Basic AMD NPU is already in but needs updates to firmware and driver to latest to support using the NPU in things like Fastflow LLM.
Latest firmware and drivers are available but need to be incldued in the kernel before they can be used. Current drivers are outdated.
Impact
This will enable NPU use for local LLM and other AI workloads
User Story
Users can offload AI tasks and enable LLM Processing for very low energy use to the NPU in APU based systems.
I’ll toss a vote - I’m not against it, though I think this’ll be one of those “wait long enough & it’ll happen” regardless of the feature request or not
Edit; don’t forget to vote for your own feature request!
Sorry, Didn’t know that. This version is literally the one I have and afaik it’s the latest from AMD and it’s the one mentioned as a requirement in the amd documentation for lemonade.
Kernel should be 6.17 or higher so the 6.18 in truenas 26 should be fine. Just needs the amdxdna-dkms driver on board.
There’s no official way to update/intsall drivers yourself. Driver gets included/updated when ever truenas gets an update (espacially if it’s a driver that’s build into the kernel). The kernel only gets updates with major truenas versions. So the next kernel update will be with truenas 26 in Q3/4 this year.
You might be stuck waiting for next years version of TrueNAS 27 to see an update. TrueNAS is conservative on what is updated.
There is still an expected 26 Release Candidate and the 26 Release expected later this year but I expect they are just working on stability and bug fixes going foreward on the 26 series.
Correct! However, working with someone in the Minisforum discord we were able to use sysext to overlay new files with the correct drivers and get the NPU working with Truenas.
We had to compile the driver ourselves for the 6.18 kernel.