Talos Kubernetes as a TrueNAS SCALE App

Apps and Virtualization
1

While our previous advice to run Kubernetes on TrueNAS SCALE/community, has always been to run Talos OS inside a VM.

The experimental nature of the new VM system has thrown in multiple complications.

Hence we set forth to do R&D on alternatives. With that we’ve come full-circle and have come up with some interesting ways on running a Talos OS kubernetes stack… Within the TrueNAS Apps ecosystem using Docker-Compose.

While there are downsides, so are there downsides with using experimental VMs. Our research and testing indicates it’s (at least) stable enough for the more experimentally inclined home-users.

We’re also still looking for people to play with it and thus have added some things that need additional testing/conformation.

Check it out and have fun!
https://truecharts.org/news/docker-compose-talos/

4 Likes
2

Choice is always good, may not be for everyone but using Talos and Kubernetes is fun if you’re looking into getting into DevOps/Gitops and learning tools like Flux and Renovate

1 Like
3

What would you say that the value-add is here compared to just running a straight up Docker-app without the extra layers?

As far as I can see, it would be running a Dockerised Talos OS that would in turn run Kubernetes that would in turn run one of your Helm charts, is that accurate?

It strikes me as rather convoluted.
It also looks like you give yourselves rather high privileges in that Compose file with the direct access to /dev/zfs.

1 Like
4

Some people want to use kubernetes, let’s not go into a full blown docker-compose vs kubernetes discussion here. If you want answers on that, there are many threads and articles about it already.

But TLDR:
Some features are offered by kubernetes, that are not offered by compose.

TalosOS is a kubernetes os, but yes thats correct.
What you run on it is your own choice.

It’s a choice for people that already want to run kubernetes or run it already as a VM.

It already runs as root and privileged.
The /dev/zfs mount point is there for people that want to test-out openebs ZFSLocal PV (just like the old scale apps could use)

TLDR:
It’s aimed at an alternative for people previously using a VM to run Talos and those using “jails” to run kubernetes. Its not for the every-day user that just wants to run a few containers.