Right.
Updating the license would allow Incus to fully integrate any code from truenas_incus_ctl
in the future
The Storage Driver and the Incus support in Fangtooth are really separate things.
The potential was amazing once the Incus version in TrueNAS had the Storage Driverā¦
Meanwhile, if you havenāt already, checkout this cool little tool:
I updated the OP Known Issues in regards to the Nvidia GPU issue with the nvidia-container-toolkit
as resolved in 25.04.2
.
Just spent a few hours reading about the fate of incus in 25.10.
Iāve been on Scale for around 4-5 years, since before the official release of Angelfish.
It has been a roller-coast for the last 4-5 years, having to rework my homelab apps/VMs/containers many times over for each breaking release. I finally found a sense of stability with Jailmaker, and a sense of optimism with Incus. I really thought incus would bring an end to breakages and give me control of my apps/containers.
Iām ready to alight from the roller-coaster and treat TN purely as a storage solution. Iāve been running proxmox on lightweight hardware for a few years with zero issues. Iāll see if I can migrate to proxmox+TN on my nas for my storage+gpu workloads.
Huge shout-out and thanks to @dasunsrule32 for your work on incus, you have clearly put in a lot of work, and it would be heartbreaking to hear about the TNCE direction change.
In the same fashion, @Stux your work on Jailmaker and providing docker solutions has been incredible.
Vox populi, vox dei.
Yep, team Jailmaker here, still running and working with no issue. I wonder if itās possible to just keep it this way. No need for UI work!
Wait a minute. Are you saying that you can install, manage, and update an operating system with its own package management, user tools, software, filesystem, and network stack, giving you full control without affecting the host NAS and without resorting to VMs, while keeping overhead at nearly zero?
Finally! I can already think of so many benefits of doing that.
Been doing it for over a year with jailmaker i run on jail with all my whole docker stack running inside it. survived 3 truenas updates without problemsā¦
It looks like Iām going to have to rollback to jailmaker at some point or move on with my own build with Incus/Proxmox. I havenāt decided yet, but Iām leaving heavily towards my own build.
Yeah, thatās what Incus brings, just like jailmaker. I donāt need a GUI, itās nice to have, but not needed. I just want to know that Iāll have support for what I need. I do like the extra orchestration that Incus brings though vs one off instances in jailmaker.
I canāt afford separate storage and compute boxes, thatās one of the reasons I loved SCALE, but also I could scale out over time if I could afford more boxes.
This ājailsā thing⦠Iāll need to look into it. I could really use it for my NAS!
What a simple yet great concept.
Iāve failed at keeping up with all the truenas direction changes lately.
If I understand, incus is out. Whatās going to replace it for lxc like containers/jails? Iāve been sticking with jailmaker while things shake out but it has certainly had itās issues (such as how it likes to mount the entire /usr/lib/x86_64-linux-gnu folder as read only if you enable nvidia passthrough - which in turn breaks any ability to do apt-get update/installs).
With extensive trial and error, I did figure out I could change one line in the most recent jlmkr.py script and stop it from mounting the entire /usr/lib/x86_64-linux-gnu folder as read only ⦠and that āseemsā to work for me right now. No idea if Iām causing myself a future problem or not.
For reference, the line I changed is
line 437: library_folders = set(str(Path(x).parent) for x in nvidia_libraries)
changed to: library_folders = set(str(x) for x in nvidia_libraries)
Do I just stick with this solution for now? Is there a better option?
Stick with whatever youāre on for now. From what I understand, is they are looking to migrate to straight LXC for containers and remove Incus.
Also, look at the jailmaker
thread. I posted about the library stuff on nvidia gpu passthrough over there.
I believe you: I can also say that wasnāt the case for me.
K3s, apps worked
Docker migration was seamless, apps worked. Including my custom one.
VMs are libvirt and remain libvirt - no need to take a detour into āexperimentalā. Also I donāt run Home Assistant so I donāt actually need any VMs.
Incus LXC I played with for the giggles, but, āexperimentalā - I may try again with 25.10.
My experience with SCALE and then CE has been that apps continue working with each upgrade.
Totally agree with @yorick. I just now updated from 24.10.3 to 25.04.2.1 and I dont have any problems with VMs or anything else.
I believe anyone who did it the same would also be ok.
FWIW, I suspect that Incus could be installed in a dataset and launched fairly easily, similar to how jailmaker is installed.
Its only requirement is that the idmap range be created.
Yeah for sure, anything is possible. Iām not sure I have the bandwidth to do that right now. Work is insanely busy right now.
I just came to say goodbye. Itās been a fun ride. I started with FreeNAS 8.3 and my server was updated and upgraded to 25.04.2.1.
I have finished my migration to Proxmox, just a few more details to figure out, but overall it was a pretty smooth transition based on the migration plan I wrote up.
Maybe see some of you on the other side. Good look out there!