24.10 + Nvidia vGPU w/multiple Apps (Docker)?

TrueNAS General
1

Hello!

I have an Nvidia Tesla P40 with 24GB of ram and I would like to divvy up this card across multiple apps.

Is this possible with 24.10 and Docker out of the box? Or is this new Nvidia driver manager thingy only able to use a single GPU device to a single app?

/TL;DR

I currently run proxmox as the host, and PCI passing the entire GPU into the TrueNAS VM.

Maybe I should vGPU the device in Proxmox, and assign mutltiple GPUs to the TrueNAS VM? Like, 4x vGPUs?

2

never used proxmox but from my understating your running truenas scale in prmox? form my xp you can run apps all hitting the gpu just as long your powersuply can handle it nothing will crash if not jut do a power limit on the gpu

1 Like