Problem/Justification
Basic AMD NPU is already in but needs updates to firmware and driver to latest to support using the NPU in things like Fastflow LLM.
Latest firmware and drivers are available but need to be incldued in the kernel before they can be used. Current drivers are outdated.
Impact
This will enable NPU use for local LLM and other AI workloads
User Story
Users can offload AI tasks and enable LLM Processing for very low energy use to the NPU in APU based systems.
I’ll toss a vote - I’m not against it, though I think this’ll be one of those “wait long enough & it’ll happen” regardless of the feature request or not
Edit; don’t forget to vote for your own feature request!
Sorry, Didn’t know that. This version is literally the one I have and afaik it’s the latest from AMD and it’s the one mentioned as a requirement in the amd documentation for lemonade.
Kernel should be 6.17 or higher so the 6.18 in truenas 26 should be fine. Just needs the amdxdna-dkms driver on board.
There’s no official way to update/intsall drivers yourself. Driver gets included/updated when ever truenas gets an update (espacially if it’s a driver that’s build into the kernel). The kernel only gets updates with major truenas versions. So the next kernel update will be with truenas 26 in Q3/4 this year.