Got it working finally. For anyone running into the same issue:
Edit the file /usr/lib/netdata/conf.d/python.d.conf and add:
nvidia_smi: yes
For some reason a lot of directories were read only, including /usr so I had to run:
zfs set readonly=off boot-pool/ROOT/24.04.0/usr
Ran debugging to see if it worked (plugin located in /usr/lib/netdata/plugins.d):
./python.d.plugin nvidia_smi debug
And that worked so just had to restart the Netdata service and it started showing up.