TrueNAS Scale - Stuck on "Welcome to GRUB"

Okay I’m going slightly insane here! We had TrueNAS Core installed on our Supermicro SSG-640SP-E1CR90 storage array up until recent and it installed and ran fine. We had a use case where we wanted a Proxmox Backup Server VM to be hosted, mounting one of the local pools so we could sync our primary PBS server over to the TrueNAS. In theory everything worked, until the sync process tried to sync one of the 12TB VM disk images, almost immediately after starting this sync the VM would hang and the sync job would fail. We have had this working on bare metal hardware without issue. I tried up’ing the VM ram allocation (200GB RAM available, tried 50/50 split from Host/VM, tried 60/40, 40/60 and so on, each time the result was the same).

The more I read into it this seemed likely due to the hypervisor used on FreeBSD (Bhyve) and some instability. See as we’ve had PBS running on KVM perfectly fine in the past, I thought why not try TrueNAS Scale.

Firstly, the migration from Core > Scale failed, landing me on the GRUB recovery screen. No biggy, was fully anticipating having to clean install if it came to it!

However, it’s now been 2 days of trying various combos of UEFI only, Dual UEFI/BIOS options, installing to both local nvme drives, installing to a single drive, updating the BIOS and BMC firmware on the host, resetting BIOS (just in case i’d changed the wrong setting somewhere), dropping into truenas shell and wiping both nvme drives with dd in case old boot loaders still remained on disk, but nothing I try is working.

Anybody got any idea’s on what else I can try, I’d really rather not have to install UnRAID if I can avoid it!

I’ve tried embedding photos to aid in troubleshooting but keep getting “Sorry, you cannot embed images” If there is a platform that is preferred to upload the images and share, please let me know.

Try to direct message a Mod and ask to be bumped a trust level to post images.

https://forums.truenas.com/g/moderators

What Scale version? You probably should stick to Electric Eel, 24.10 and hold off on Fangtooth, 25.04. EE is considered more stable and doesn’t have the ‘experimental’ Incus.

When you joined the forum, you got a DM from truenas-bot inviting you to take a tutorial. Find that DM and complete the tutorial, which will increase your trust level. Or just spend some time browsing around the forum, which will in due course achieve the same thing.

Linking to images on external sites is distinctly disfavored.

1 Like

Christ! That bot training was more involved than I expected :smile:

And some more

Even tried manually adding the boot option, allowed me to add the boot option, but even manually trying to boot from it from the bios override didn’t work, still get the Welcome to GRUB screen.

This page seems to sum up my issue. I’ve tried everything bar installing to a USB for testing, which I will try tomorrow.

I also believe this is why I had no luck with BIOS boot mode, because then TrueNAS couldn’t see the onboard nvme drives at all.

Oh, and I’ve tried both v25 and v24 (current versions listed on the main downloads page)

Another update:

I have tried physically removing one of the two onboard nvme cards, wiping the remaining nvme using dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=100 and then installing TrueNAS Scale 24 again. Same result.

I then tried reimaging using rufus, ensuring UEFI was chosen and dd was the copying mode. Still no dice.

Trying to install onto a USB drive next, will update this page afterwards.

USB installation failed…