TrueNAS scale running Home assistant VM - Ollama app -- Can't connect

Apps and Virtualization
1

Hello and happy new year to all.

I have a HAOS VM running in my TrueNAS scale. The VM works amazing thus far. I have also installed Ollama app in TrueNAS, and have used it a bit. I now want to integrate Ollama with Home assistant, as the native voice commands are … not great for me (mostly because English isnt my native language i suppose).

I cannot connect these to eachother. I have searched the internet, and come up empty handed. Just for fun, i tried installing Ollama on windows, and it connected in 1 second.

What can this be? I use 192.168.10.98 for my truenas instance, and my VM has a static ip of the same but .97. Ollama is installed on port 31028 as it was the default port during installation.

I have read something about ollama using 127.0.0.1 and needs to be on 0.0.0.0 (???) but I cant seem to figure out how to change that in TrueNAS.

Any help would be lovely.

Ps. I can run it on windows, but need to change a lot of hardware and it will run slower as that computer does not have a GPU. So optimally i would like to use the truenas scale instance for ollama.

Thanks in advance,

1 Like
2

I am stuck on a similar issue, I setup HAOS vm properly and Ollama via Apps. Under Ollama app < Workload< Shell. You can pull the Ollama model through the container shell and it will install properly. you can run Curl command using powershell to test to see if it can see the model. Example: curl -v YourIPAddress:31028_
Output:
StatusCode : 200
StatusDescription : OK
Content : Ollama is running
ETC…

Now to the HAOS part if you try to use the built in integration for Ollama it will not accept yourtruenasIp:31028 for some reason. I tried creating a custom script using .YAML in HA but no luck getting it working. I am hoping someone can help figure how to use the HA integration of Ollama by entering Truenas+ Ollama Port into the URL instead of creating a custom script.

3

Does your VM have a bridge? See → Accessing NAS from a VM or Apps | TrueNAS Documentation Hub

2 Likes
5

You’ll have to check the logs, aka cat /var/log/app_lifecycle.log to see why it’s not working

6

Disregard, it was due to my global dns nameserver using my gateway after the bridge changes. For some reason it did not like it.

1 Like
7

As StevenMcE mentioned; you need a bridge network interface. Otherwise your embedded devices in TrueNAS Scale cannot access shares and so on.
You need to start at TrueScale itself and create the bridge. Afterwards you need to select this bridge network interface in eg your VM.

1 Like
8

Hello and thanks all for your replies.

This worked. I did not know i needed to do this. I just followed the instructions provided in the links, and it worked like a charm. Amazing. Thanks a ton.

Wish you all a wonderful new years,

1 Like