I have a P40 running Ollama with qwen 32b model. I setup a Ubuntu VM and passthru the Tesla. I use it with Home Assistant and response time is at least 10x over cpu. I use a Quadro P620 for Emby transcoding.
I have a P40 running Ollama with qwen 32b model. I setup a Ubuntu VM and passthru the Tesla. I use it with Home Assistant and response time is at least 10x over cpu. I use a Quadro P620 for Emby transcoding.