Issues Running TrueNAS Scale in a VM - Middleware and ZFS Errors

[solnas]

I am encountering persistent issues when trying to run TrueNAS Scale inside a virtual machine (VM). TrueNAS Core, running on the same hypervisor, works without major issues (aside from occasional python3.9 core dumps), but TrueNAS Scale fails to boot properly. Below are the setup details, logs, and questions for the community.

Steps to Reproduce

1. Create a new VM for TrueNAS Scale.
2. Use default configurations (detailed below).
3. Boot the VM.

Expected Result
The TrueNAS Scale VM boots successfully without errors.

Actual Result
The TrueNAS Scale VM fails to boot, with multiple errors, including:

• Middleware (middlewared.service) failing to initialize.
• Disk cache table and ZFS pool import issues (ix-syndisks.service and ix-zfs.service).

Environment

• Hypervisor: Proxmox

• TrueNAS Core VM Configuration:

  • Memory: 16 GB
  • CPUs: 8 cores
  • BIOS: SeaBIOS
  • Storage: VirtIO SCSI Disk (32 GB)
  • Network: VirtIO
    (Works fine apart from occasional core dumps.)

• TrueNAS Scale VM Configuration:

  • Memory: 8 GB
  • CPUs: 8 cores
  • BIOS: SeaBIOS
  • Storage: VirtIO SCSI Disk (32 GB)
  • Network: VirtIO
    (Fails to boot with middleware and ZFS errors.)

Logs and Errors

1. Middleware Error Logs:

   Traceback (most recent call last):
     File "/usr/bin/middlewared", line 33, in <module>
       sys.exit(load_entry_point('middlewared==0.0.0', 'console_scripts', 'middlewared')())
     File "/usr/lib/python3/dist-packages/middlewared/main.py", line 2220, in main
       ).run()
     File "/usr/lib/python3/dist-packages/middlewared/main.py", line 2034, in run
       self.loop.run_until_complete(self.__initialize())
     File "/usr/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
       return future.result()
     File "/usr/lib/python3/dist-packages/middlewared/schema/patch.py", line 24, in resolve
       cp.attrs[name] = attr.copy()
   AttributeError: 'tuple' object has no attribute '__dict__'

2. Service Failures:

   • middlewared.service fails to initialize TrueNAS middleware.
   • ix-syndisks.service fails to sync the disk cache table.
   • ix-zfs.service fails to import ZFS pools.

3. Console Logs:

   Failed to start middlewared.service - TrueNAS Middleware.
   Failed to import ZFS pools. See "systemctl status ix-zfs.service" for details.
   

Screenshots

Additional screenshots of the errors during the boot process:

1. Middleware Errors:
   

2. ZFS and Disk Cache Errors:
   

Troubleshooting Steps Taken

1. Verified the ISO file integrity using the SHA256 checksum.
2. Tested default VM configurations for TrueNAS Scale.
3. Compared VM settings with TrueNAS Core, which works fine.
4. Reviewed logs and ensured no apparent misconfiguration.

Questions for the Community

1. Are there any known compatibility issues with TrueNAS Scale on Proxmox using VirtIO devices?
2. Could the issues with TrueNAS Scale be related to the hypervisor or specific VM configurations (e.g., BIOS settings, machine type)?
3. Are there recommended configurations for running TrueNAS Scale VMs?
4. Would testing TrueNAS Scale on bare metal help isolate the issue?

Attachments

• Full logs and screenshots of the errors.
• VM configuration details for both Core and Scale.

[solnas]

A more active thread was created on proxmox, but ended up switching to baremetal TrueNAS on a different machine now with no more issues.

I was not able to find a solution.