Ollama and Intel GPU

Try this while you’re trying to start the container:

sudo journalctl -fu docker

This is what came up

Odin% sudo journalctl -fu docker
Apr 17 14:06:04 Odin dockerd[11001]: time="2025-04-17T14:06:04.962936472-05:00" level=info msg="ignoring event" container=d574a829c21f45d54da8868d73e4f06c21258c0cf1c1c5f9b31de758ed589abb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:07:05 Odin dockerd[11001]: time="2025-04-17T14:07:05.538522150-05:00" level=info msg="ignoring event" container=d574a829c21f45d54da8868d73e4f06c21258c0cf1c1c5f9b31de758ed589abb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:08:05 Odin dockerd[11001]: time="2025-04-17T14:08:05.853425935-05:00" level=info msg="ignoring event" container=d574a829c21f45d54da8868d73e4f06c21258c0cf1c1c5f9b31de758ed589abb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:09:06 Odin dockerd[11001]: time="2025-04-17T14:09:06.320664059-05:00" level=info msg="ignoring event" container=d574a829c21f45d54da8868d73e4f06c21258c0cf1c1c5f9b31de758ed589abb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:06 Odin dockerd[11001]: time="2025-04-17T14:10:06.693589706-05:00" level=info msg="ignoring event" container=d574a829c21f45d54da8868d73e4f06c21258c0cf1c1c5f9b31de758ed589abb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:28 Odin dockerd[11001]: time="2025-04-17T14:10:28.734663188-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:29 Odin dockerd[11001]: time="2025-04-17T14:10:29.787945338-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:30 Odin dockerd[11001]: time="2025-04-17T14:10:30.811343638-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:31 Odin dockerd[11001]: time="2025-04-17T14:10:31.831014801-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:33 Odin dockerd[11001]: time="2025-04-17T14:10:33.076250620-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:35 Odin dockerd[11001]: time="2025-04-17T14:10:35.149285870-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:38 Odin dockerd[11001]: time="2025-04-17T14:10:38.772334470-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:45 Odin dockerd[11001]: time="2025-04-17T14:10:45.652870738-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:10:58 Odin dockerd[11001]: time="2025-04-17T14:10:58.884796354-05:00" level=info msg="ignoring event" container=c0f2cb8c4cfa478fe5a8a27e9dc52e069618294d1b5323828cd9cd7b60dd18b2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:13 Odin dockerd[11001]: time="2025-04-17T14:11:13.192867054-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:14 Odin dockerd[11001]: time="2025-04-17T14:11:14.019876942-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:14 Odin dockerd[11001]: time="2025-04-17T14:11:14.832016970-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:15 Odin dockerd[11001]: time="2025-04-17T14:11:15.649748162-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:16 Odin dockerd[11001]: time="2025-04-17T14:11:16.883839848-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:18 Odin dockerd[11001]: time="2025-04-17T14:11:18.922734974-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:22 Odin dockerd[11001]: time="2025-04-17T14:11:22.543378409-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Apr 17 14:11:29 Odin dockerd[11001]: time="2025-04-17T14:11:29.313609849-05:00" level=info msg="ignoring event" container=88ede2d87e9333afc9c3001864cb12b1c778c2d41289d0f4b4a39e67afc1ac43 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

Have you progressed any further? I was seeing the same error you were from the last post, but then saw some other images being used for Arc. I tried some variations of below, but the container would just crash. Logs appear below:

networks: {}
services:
  ipex-llm:
    container_name: ipex-llm-container
    devices:
      - /dev/dri:/dev/dri
    environment:
      - no_proxy=localhost,127.0.0.1
      - bench_model=llama-3.2-from-scratch
      - DEVICE=Arc
    image: intelanalytics/ipex-llm-serving-xpu:latest
    mem_limit: 16g
    network_mode: host
    ports:
      - '11434:11434'
    privileged: False
    shm_size: 8g
    volumes:
      - /mnt/.ix-apps/app_configs/ollama-ipex-llm:/models

Logs:

2025-04-24 02:17:05.293396+00:00raise ValueError(f"No supported config format found in {model}")
2025-04-24 02:17:05.293411+00:00ValueError: No supported config format found in default_model_path

Wondering if we need to go down a route listed here. If this was just another raspberry pi type host, I would, but I would like to keep the TrueNas separate from outside influences. I guess then it could come down to creating a custom image.

1 Like

I haven’t make any more progress :frowning:

I am disappointed that my Intel GPU isn’t working across the board with the apps, be that as it may, I think the only option is to try to install this inside a container or a vm vs directly on TrueNAS.

Yea, I’m planning on trying this as next steps.

I’ve done some extensive playing with the ipex / ollama containers. I managed to get it working exactly one time, but it was very manual to do so. We’ll wait on updating our App until Ollama “officially” decides to import Intel GPU support. The 3rd party containers are rough still, but there is an open feature request on the Ollama side.

2 Likes

That feature request is from 2023…

I found this…