If you do zpool import -f QWARD
will the system crash?
If it does, try zpool import -fFn QWARD
- the extra capital -F
is for a rewinding mount, and the -n
is a no-op (to not actually mount it) - what we want out of that is “no output, but also not a crash.”
2 Likes
I booted up to the GUI on my desktop. Then when it was up I plugged in the drive for QWARD.
I tried both of your suggestions and both times it long paused then crashed. It then bootlooped the same way it usually does when I try to boot it up with the drive already connected.
the extra capital -F is for a rewinding mount, and the -n is a no-op (to not actually mount it)
Thank you for explaining what we are doing along the way
etorix
December 6, 2024, 8:33pm
23
@HoneyBadger indeed deserves praise for his skills, his availability, and his patience in explaining along the way.
Otherwise man zpool
is your friend.
1 Like
@HoneyBadger any other suggestions on what I can do?
Sorry for the delay. Crashing on attempt to import the pool is usually indicative of some manner of significant spacemap/metadata corruption - which unfortunately isn’t unheard of with the WD SMR drives.
Can you reboot (with the drive disconnected, and then connect it, to bypass boot loop) and then get the labels with sudo zdb -ul /dev/sdX
targeting that EFAX drive?
2 Likes
No worries. I just wanted to check to see if you were still down to help.
I tried doing the command sudo zdb -ul /dev/sdX
verbatim but it didn’t pull anything up. Am I supposed to be substituting the X with the drive number or something? How do I target the EFAX drive? Do I go by something in the Disk section like it shows here?
Please let me know.
Yes, you replace the X as you suspected. You should be referring to your paper list so you can keep the drive serial numbers to model numbers straight. Their positions and device names may change between reboots, etc.
It’s not that I don’t have my serial numbers/model numbers straight, it’s more that I don’t know what info I need to input.
So do I enter sdX[replace X with ModelNumber] or sd[replace X with SerialNumber] or something else like replace sdX with the disk name da2 like in my previous picture?
Perhaps I’m supposed to put something after sdX?
like sudo zdb -ul /dev/sdX [SerialNumber]
?
If you could clarify that for me that would be very helpful.
etorix
December 17, 2024, 7:27am
29
You use your record of serial numbers to find out which letter the EFAX drive has at this moment (letters may reshuffle at each reboot) and type
sudo zdb -ul /dev/sda
or
sudo zdb -ul /dev/sdb
or
sudo zdb -ul /dev/sdc
…
as appropriate. Nothing else.
1 Like
@HoneyBadger @SmallBarky @etorix
I was kind of confused about how the code looks different and also the mention of sdX and I think I know why.
it starts with sudo which seemed familiar because I think that’s Linux
I looked up the sdX thing and it turns out that’s the designation used for drives in TrueNas Scale
Then I remembered a friend of mine told me that TrueNas Scale uses Linux
I am currently using TrueNas Core which, based on my understanding, does not use Linux (at least in the same way) and uses daX (ada, da0, da1 etc) to designate drives.
I was wondering if there is an equivalent to sudo zdb -ul /dev/sda
that works with Core?
Yes, you can use zdb -ul /dev/daX
here - no sudo
needed, as you’re root
by default on CORE, and substitute the BSD-style device names of da0
up to daX
for your drives.
2 Likes
HoneyBadger:
zdb -ul /dev/daX
FreeBSD 13.1-RELEASE-p9 n245431-b8ec9bde091 TRUENAS
TrueNAS (c) 2009-2024, iXsystems, Inc.
All rights reserved.
TrueNAS code is released under the modified BSD license with some
files copyrighted by (c) iXsystems, Inc.
For more information, documentation, help or support, go here:
http://truenas.com
Welcome to TrueNAS
Warning: the supported mechanisms for making configuration changes
are the TrueNAS WebUI and API exclusively. ALL OTHERS ARE
NOT SUPPORTED AND WILL RESULT IN UNDEFINED BEHAVIOR AND MAY
RESULT IN SYSTEM FAILURE.
root@lilNasX[~]# zdb -ul /dev/da0
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
------------------------------------
LABEL 2
------------------------------------
Uberblock[64]
magic = 0000000000bab10c
version = 5000
txg = 5718656
guid_sum = 340813584344512331
timestamp = 1713838519 UTC = Mon Apr 22 19:15:19 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[68]
magic = 0000000000bab10c
version = 5000
txg = 5718593
guid_sum = 340813584344512331
timestamp = 1713838202 UTC = Mon Apr 22 19:10:02 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[72]
magic = 0000000000bab10c
version = 5000
txg = 5716642
guid_sum = 340813584344512331
timestamp = 1713828406 UTC = Mon Apr 22 16:26:46 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[76]
magic = 0000000000bab10c
version = 5000
txg = 5718755
guid_sum = 340813584344512331
timestamp = 1713839016 UTC = Mon Apr 22 19:23:36 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[80]
magic = 0000000000bab10c
version = 5000
txg = 5718980
guid_sum = 340813584344512331
timestamp = 1713840146 UTC = Mon Apr 22 19:42:26 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[84]
magic = 0000000000bab10c
version = 5000
txg = 5718725
guid_sum = 340813584344512331
timestamp = 1713838866 UTC = Mon Apr 22 19:21:06 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[88]
magic = 0000000000bab10c
version = 5000
txg = 5718950
guid_sum = 340813584344512331
timestamp = 1713839995 UTC = Mon Apr 22 19:39:55 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[92]
magic = 0000000000bab10c
version = 5000
txg = 5714407
guid_sum = 340813584344512331
timestamp = 1713817180 UTC = Mon Apr 22 13:19:40 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[96]
magic = 0000000000bab10c
version = 5000
txg = 5716776
guid_sum = 340813584344512331
timestamp = 1713829079 UTC = Mon Apr 22 16:37:59 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[100]
magic = 0000000000bab10c
version = 5000
txg = 5718249
guid_sum = 340813584344512331
timestamp = 1713836477 UTC = Mon Apr 22 18:41:17 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[104]
magic = 0000000000bab10c
version = 5000
txg = 5718794
guid_sum = 340813584344512331
timestamp = 1713839212 UTC = Mon Apr 22 19:26:52 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[108]
magic = 0000000000bab10c
version = 5000
txg = 5715275
guid_sum = 340813584344512331
timestamp = 1713821539 UTC = Mon Apr 22 14:32:19 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[112]
magic = 0000000000bab10c
version = 5000
txg = 5718988
guid_sum = 340813584344512331
timestamp = 1713840186 UTC = Mon Apr 22 19:43:06 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[116]
magic = 0000000000bab10c
version = 5000
txg = 5718669
guid_sum = 340813584344512331
timestamp = 1713838584 UTC = Mon Apr 22 19:16:24 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[120]
magic = 0000000000bab10c
version = 5000
txg = 5717998
guid_sum = 340813584344512331
timestamp = 1713835217 UTC = Mon Apr 22 18:20:17 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 2 3
Uberblock[124]
magic = 0000000000bab10c
version = 5000
txg = 5715279
guid_sum = 340813584344512331
timestamp = 1713
@HoneyBadger do you have any suggestions for next steps?
You may need to try zdb -ul /dev/da0p1
or zdb -ul /dev/da0p2
to pick up the actual ZFS partition on the drive. It is able to pick up some uberblocks which is a good sign but it wasn’t able to find the label - that should be resolved by targeting the partition itself.
@HoneyBadger
I tried both and partition 2 worked. What can I do as my next step now?
Just to see, I tried to import the pool again but its still not showing up. I guess most of this will be done via Shell.
So just to confirm, eventually what we want to do is be able to mirror the data on this drive to another one and be able to import this into the QWARD pool?
FreeBSD 13.1-RELEASE-p9 n245431-b8ec9bde091 TRUENAS
TrueNAS (c) 2009-2024, iXsystems, Inc.
All rights reserved.
TrueNAS code is released under the modified BSD license with some
files copyrighted by (c) iXsystems, Inc.
For more information, documentation, help or support, go here:
http://truenas.com
Welcome to TrueNAS
Warning: the supported mechanisms for making configuration changes
are the TrueNAS WebUI and API exclusively. ALL OTHERS ARE
NOT SUPPORTED AND WILL RESULT IN UNDEFINED BEHAVIOR AND MAY
RESULT IN SYSTEM FAILURE.
root@lilNasX[~]# zdb -ul /dev/da0p1
failed to unpack label 0
failed to unpack label 1
failed to unpack label 2
failed to unpack label 3
root@lilNasX[~]# zdb -ul /dev/da0p2
------------------------------------
LABEL 0
------------------------------------
version: 5000
name: 'QWARD'
state: 0
txg: 5711671
pool_guid: 2389805668425095959
errata: 0
hostid: 1556904181
hostname: ''
top_guid: 15841037234986924867
guid: 3702599358093525292
vdev_children: 1
vdev_tree:
type: 'mirror'
id: 0
guid: 15841037234986924867
metaslab_array: 132
metaslab_shift: 34
ashift: 12
asize: 3998634737664
is_log: 0
create_txg: 4
children[0]:
type: 'disk'
id: 0
guid: 15300859470258069445
path: '/dev/gptid/e495c1e7-ea16-11ec-bcb3-94de80684542'
phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
DTL: 5798
create_txg: 4
removed: 1
children[1]:
type: 'disk'
id: 1
guid: 3702599358093525292
path: '/dev/gptid/e4c6902d-ea16-11ec-bcb3-94de80684542'
phys_path: 'id1,enc@n3061686369656d30/type@0/slot@5/elmdesc@Slot_04/p2'
DTL: 5797
create_txg: 4
features_for_read:
com.delphix:hole_birth
com.delphix:embedded_data
labels = 0 1 2 3
Uberblock[0]
magic = 0000000000bab10c
version = 5000
txg = 5718656
guid_sum = 340813584344512331
timestamp = 1713838519 UTC = Mon Apr 22 19:15:19 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[1]
magic = 0000000000bab10c
version = 5000
txg = 5718593
guid_sum = 340813584344512331
timestamp = 1713838202 UTC = Mon Apr 22 19:10:02 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[2]
magic = 0000000000bab10c
version = 5000
txg = 5716642
guid_sum = 340813584344512331
timestamp = 1713828406 UTC = Mon Apr 22 16:26:46 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[3]
magic = 0000000000bab10c
version = 5000
txg = 5718755
guid_sum = 340813584344512331
timestamp = 1713839016 UTC = Mon Apr 22 19:23:36 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[4]
magic = 0000000000bab10c
version = 5000
txg = 5718980
guid_sum = 340813584344512331
timestamp = 1713840146 UTC = Mon Apr 22 19:42:26 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[5]
magic = 0000000000bab10c
version = 5000
txg = 5718725
guid_sum = 340813584344512331
timestamp = 1713838866 UTC = Mon Apr 22 19:21:06 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[6]
magic = 0000000000bab10c
version = 5000
txg = 5718950
guid_sum = 340813584344512331
timestamp = 1713839995 UTC = Mon Apr 22 19:39:55 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[7]
magic = 0000000000bab10c
version = 5000
txg = 5714407
guid_sum = 340813584344512331
timestamp = 1713817180 UTC = Mon Apr 22 13:19:40 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[8]
magic = 0000000000bab10c
version = 5000
txg = 5716776
guid_sum = 340813584344512331
timestamp = 1713829079 UTC = Mon Apr 22 16:37:59 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[9]
magic = 0000000000bab10c
version = 5000
txg = 5718249
guid_sum = 340813584344512331
timestamp = 1713836477 UTC = Mon Apr 22 18:41:17 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[10]
magic = 0000000000bab10c
version = 5000
txg = 5718794
guid_sum = 340813584344512331
timestamp = 1713839212 UTC = Mon Apr 22 19:26:52 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[11]
magic = 0000000000bab10c
version = 5000
txg = 5715275
guid_sum = 340813584344512331
timestamp = 1713821539 UTC = Mon Apr 22 14:32:19 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[12]
magic = 0000000000bab10c
version = 5000
txg = 5718988
guid_sum = 340813584344512331
timestamp = 1713840186 UTC = Mon Apr 22 19:43:06 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[13]
magic = 0000000000bab10c
version = 5000
txg = 5718669
guid_sum = 340813584344512331
timestamp = 1713838584 UTC = Mon Apr 22 19:16:24 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[14]
magic = 0000000000bab10c
version = 5000
txg = 5717998
guid_sum = 340813584344512331
timestamp = 1713835217 UTC = Mon Apr 22 18:20:17 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[15]
magic = 0000000000bab10c
version = 5000
txg = 5715279
guid_sum = 340813584344512331
timestamp = 1713821559 UTC = Mon Apr 22 14:32:39 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[16]
magic = 0000000000bab10c
version = 5000
txg = 5718544
guid_sum = 340813584344512331
timestamp = 1713837956 UTC = Mon Apr 22 19:05:56 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[17]
magic = 0000000000bab10c
version = 5000
txg = 5718801
guid_sum = 340813584344512331
timestamp = 1713839247 UTC = Mon Apr 22 19:27:27 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[18]
magic = 0000000000bab10c
version = 5000
txg = 5718898
guid_sum = 340813584344512331
timestamp = 1713839734 UTC = Mon Apr 22 19:35:34 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[19]
magic = 0000000000bab10c
version = 5000
txg = 5718099
guid_sum = 340813584344512331
timestamp = 1713835723 UTC = Mon Apr 22 18:28:43 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[20]
magic = 0000000000bab10c
version = 5000
txg = 5718868
guid_sum = 340813584344512331
timestamp = 1713839583 UTC = Mon Apr 22 19:33:03 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[21]
magic = 0000000000bab10c
version = 5000
txg = 5718965
guid_sum = 340813584344512331
timestamp = 1713840070 UTC = Mon Apr 22 19:41:10 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[22]
magic = 0000000000bab10c
version = 5000
txg = 5718838
guid_sum = 340813584344512331
timestamp = 1713839433 UTC = Mon Apr 22 19:30:33 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[23]
magic = 0000000000bab10c
version = 5000
txg = 5714807
guid_sum = 340813584344512331
timestamp = 1713819190 UTC = Mon Apr 22 13:53:10 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[24]
magic = 0000000000bab10c
version = 5000
txg = 5716440
guid_sum = 340813584344512331
timestamp = 1713827390 UTC = Mon Apr 22 16:09:50 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[25]
magic = 0000000000bab10c
version = 5000
txg = 5718937
guid_sum = 340813584344512331
timestamp = 1713839930 UTC = Mon Apr 22 19:38:50 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[26]
magic = 0000000000bab10c
version = 5000
txg = 5718682
guid_sum = 340813584344512331
timestamp = 1713838650 UTC = Mon Apr 22 19:17:30 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[27]
magic = 0000000000bab10c
version = 5000
txg = 5716187
guid_sum = 340813584344512331
timestamp = 1713826119 UTC = Mon Apr 22 15:48:39 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[28]
magic = 0000000000bab10c
version = 5000
txg = 5712380
guid_sum = 340813584344512331
timestamp = 1713806996 UTC = Mon Apr 22 10:29:56 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[29]
magic = 0000000000bab10c
version = 5000
txg = 5715933
guid_sum = 340813584344512331
timestamp = 1713824842 UTC = Mon Apr 22 15:27:22 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[30]
magic = 0000000000bab10c
version = 5000
txg = 5718558
guid_sum = 340813584344512331
timestamp = 1713838027 UTC = Mon Apr 22 19:07:07 2024
mmp_magic = 00000000a11cea11
mmp_delay = 0
mmp_valid = 0
checkpoint_txg = 0
labels = 0 1 2 3
Uberblock[31]
magic = 0000000000bab10c
version = 5000
txg = 5718623
guid_sum = 3408135843
How long has this drive or pool been offline? The uberblock data from this drive is showing dates of April 22 only.
I think it has been a while due to work and personal responsibilities so I would not be surprised at all at the date.
Do you think it’s salvageable?
Potentially.
Since importing at the one at the top-level (as well as the most-recent three) failed, as implied by the crash from the -fFn
then we have a couple options:
Attempt a more extreme rewind with -nfFX
to let it push back further.
Specify the transaction group manually with -nfFXT 1234
but instead of 1234
we’ll specify one from your zdb
output. If we assume the newest three are hooped (because that’s what -F
tries by default, I believe) then instead of 1234
try transaction 5718950
from Mon Apr 22 19:39:55 2024 UTC
- so that would be "zpool import -nfFXT 5718950 QWARD
- if you don’t get a crash then try it again without the -n
in there, but keep all the other letters.
What I find a bit odd is that your label is specifying 5711671
as the entry-point, but that isn’t found in any of your 32 uberblocks listed with the -ul
output.
2 Likes
I tried it and it just kind of doesn’t do anything. It just stays on this screen… should I try it without the -n
?
It’s going to take a long time for it to think about and attempt the rewind. What you’re hoping for from this command is no output and no crash.
If you get that, then attempt the import without the -n
- and when that completes, do a zpool status