Pool Offline (but shows Online) after reboot



The main Pool on our system is showing as “OFFLINE” and is in-accessable after a recent reboot. What is the easiest way to troubleshoot without losing any of the data on there. All of the disks show up and when I do “zpool import” in CLI it shows the Pool and all the raidz2s as “ONLINE”.

I saw this post while searching: Reboot and pools offline | TrueNAS Community is it our best path forward?

Thanks!

Welcome to the TrueNAS forums!

We need more information:

  • Version of TrueNAS Core
  • Output of zpool import in CODE tags
  • Complete hardware listing
  • Make & model of the drives used and how they are wired to the server

It could be something straight forward or simple, but we can’t tell at present.

@Arwen thanks for the response, here’s some more data for you:

TrueNAS-12.0-U7

Last login: Wed Apr 23 15:29:57 on pts/1
FreeBSD 12.2-RELEASE-p11 75566f060d4(HEAD) TRUENAS

    TrueNAS (c) 2009-2021, iXsystems, Inc.
    All rights reserved.
    TrueNAS code is released under the modified BSD license with some
    files copyrighted by (c) iXsystems, Inc.

    For more information, documentation, help or support, go here:
    http://truenas.com

Welcome to TrueNAS

Warning: settings changed through the CLI are not written to
the configuration database and will be reset on reboot.

root@truenas[~]# zpool import
pool: Archive
id: 1110966487659361773
state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:

    Archive                                         ONLINE
      raidz2-0                                      ONLINE
        gptid/19bebf0e-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1a83847b-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/18e49fe1-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/199f12d2-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1a40b6be-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/19637151-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1a244166-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1a62ccc7-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1b989f21-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
      raidz2-1                                      ONLINE
        gptid/186ca28e-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/193ea01b-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/18d5959b-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/19fb15e1-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1b0e7445-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1aa67869-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1d321893-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1f88149e-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/1fb18097-6bff-11ec-9c67-0cc47a1f6e10  ONLINE
      raidz2-2                                      ONLINE
        gptid/99008178-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/996d8613-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/98454c26-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/9967ba0f-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/97dd260d-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
        gptid/984a85ab-6dba-11ec-9c67-0cc47a1f6e10  ONLINE
      raidz2-3                                      ONLINE
        gptid/3cbe5fe4-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3ce82f5c-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3cd723e7-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3ce5e047-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3cbc12c1-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3d159113-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3d0c111a-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3d323db0-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3cee99e2-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3e127d14-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3e1ecf8d-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
        gptid/3e307aa6-c1b4-11ec-916b-0cc47a1f6e10  ONLINE
      raidz2-4                                      ONLINE
        gptid/d27b3b11-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2062625-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2bcd95f-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2fa209e-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d299cc55-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2d2ef2a-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d30eecf5-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2d11afc-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d2cfbb78-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d275147b-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d3619c9f-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d3644581-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/d33fbffe-ae1a-11ed-a144-0cc47a1f6e10  ONLINE
      raidz2-5                                      ONLINE
        gptid/629576d9-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/638de29f-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/6456ffc8-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63c0b375-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63c28fdf-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63c8632b-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63bd86e5-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63cf5e07-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/64761bb2-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/63a283b1-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
        gptid/649fdb8c-ae1b-11ed-a144-0cc47a1f6e10  ONLINE
    cache
      gptid/1e3fcc25-6bff-11ec-9c67-0cc47a1f6e10
      gptid/1e4250c6-6bff-11ec-9c67-0cc47a1f6e10
      gptid/1e44249b-6bff-11ec-9c67-0cc47a1f6e10
      gptid/1e52fbfb-6bff-11ec-9c67-0cc47a1f6e10

root@truenas[~]#

Hardware - SuperMicro 36-bay chassis with Dual Xeon E5-2620 v3 CPUs & 64GB RAM. Second chassis is a 24-bay SuperMicro JBOD.

Drives are a mixture of 10TB, 12TB, & 18TB Drives. All raidz2 are Western Digital drives except for 1 that is EXOS. All drives are SATA and in sleds connected to the backplanes of the SuperMicro Chassis.

(4) 8TB NVME for Cache plugged into PCIe Slots.

Please note that all drives appear as online according to the TrueNAS WebGUI.

I don’t remember the TrueNAS Core GUI, but their should be a place to import the pool. Give that a try.

On rare occasions, we, in the forums, have seen a user have similar issues because some of the disks were not ready at the time TrueNAS Core wanted to import the pool.

With such a large number of disks, this may be your problem.

If you can’t find the GUI version of import, as a test, you can use the command line version. Just note doing so won’t start any of the normal sharing services because the TrueNAS middleware won’t know about your behind the scenes pool import.

Thanks, the Pool does not show up as an option to import in the GUI, only to “Export/Disconnect”.

If it shows as “Export/Disconnect”, then it sounds like it did eventually import the pool.

Have you re-checked zpool status to see if that was the case?

If it still does not show up, then you can try to import the pool from the command line just to verify that it works.

1 Like