Can't migrate VMs after update to 25.04

Apps and Virtualization
1

Hi!
I’ve updated my TrueNAS Scale to version 25.04, because Linux kernels of version 6.6 and older don’t work correctly with Nvidia RTX 5xxx (PCI BAR initialization errors).
However, now I can’t migrate virtual machines to Incus. I did it according to the instructions, the VM freezes when starting after printing “BdsDxe: starting Boot0002… QEMU HARDDISK… Not Found” to the console.

2

Thats because of virtio drivers. You need to set disk io.bus to nvme which doesnt need them. It isnt yet exposed in Beta UI. Currently only in nightly, wait for RC or do it yourself in shell.

3

Same error.

изображение
изображение904×395 8.65 KB

My config:

$ sudo incus config device show Win10Test
disk0:
  io.bus: nvme
  source: /dev/zvol/Work/VirtualMachines/Storage/Win10Pro-4ci02
  type: disk
root:
  path: /
  pool: default
  size: "10737418240"
  type: disk
4

One more thing I can think of is setting boot.priority = 10 for the disk0. Higher value is higher priority. Maybe it’s trying to boot from the root disk and that’s why it doesn’t work?

5

Thank you very much, setting the boot priority helped!
Is it possible to remove the root disk?

6

I just got this answered by Incus dev:

stgraber4:34 pm

The root disk must always exist and is the only one that gets snapshotted, backed up and moved around as part of the instance.

For VMs, you can make it tiny and never use it, instead relying on external disks (custom block volumes) for everything, but you can’t fully remove the root disk as it’s assumed by a lot of different code paths to be present.

2 Likes
7

The root disk must always exist… but you can replace it…