Zpool status disks with many problems, spare disk may be locked or fault?

General Discussion
1

System: FreeNAS-11.1-U5

NAME STATE READ WRITE CKSUM
pool1 DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
gptid/cc5aadbb-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
spare-1 DEGRADED 0 0 0
5146521994079950617 REMOVED 0 0 0 was /dev/gptid/de9ec45c-6283-11ee-955b-ac1f6b6c546a gptid/4fbe7aa5-8c05-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/cdc3a975-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/ce82ed4a-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/cf5efc59-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/d027f7c7-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/d107d81f-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/d1fa0b42-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/d3152db9-8bfe-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
…
raidz2-6 DEGRADED 0 0 0
gptid/1886d4c1-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/9d405b52-4188-11ee-955b-ac1f6b6c546a ONLINE 0 0 0
gptid/1c0ed4b6-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/1dc75dab-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/1f88c305-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
spare-5 DEGRADED 0 0 0
replacing-0 DEGRADED 0 0 0
spare-0 DEGRADED 0 0 0
2952479276134711775 UNAVAIL 5 40 0 was /dev/gptid/2150c0ad-8bff-11e8-99af-ac1f6b6c546a
gptid/4d4741c9-8c05-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/c5234912-822b-11ef-af2c-ac1f6b6c546a ONLINE 0 0 0
gptid/4adfc88b-8c05-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/2321d681-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/25258461-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
gptid/276a6cb6-8bff-11e8-99af-ac1f6b6c546a ONLINE 0 0 0
…
spares
1452886384188519195 INUSE was /dev/gptid/4adfc88b-8c05-11e8-99af-ac1f6b6c546a
3704549270654786752 INUSE was /dev/gptid/4d4741c9-8c05-11e8-99af-ac1f6b6c546a
1919800394822298795 INUSE was /dev/gptid/4fbe7aa5-8c05-11e8-99af-ac1f6b6c546a
gptid/521d4cfe-8c05-11e8-99af-ac1f6b6c546a AVAIL
gptid/548f5307-8c05-11e8-99af-ac1f6b6c546a AVAIL
gptid/5b292af6-e110-11e8-b248-ac1f6b6c546a AVAIL

How can we do?
Thanks
Best Regards

2

First, encapsulate the code output in CODE tags to make it readable.

Next, full hardware details

Last, output of SMART in CODE tags for the failing disks.

1 Like
3

Thanks Arwen, but please, what mean:
1)_ " encapsulate the code output in CODE tags to make it readable" ?..
2)_“full hardware details” maybe lspci with various options switch?
3)_smart output: "smartctl -l selftest for each /dev ?
Sorry… and thanks again.
Bye

4
  • zpool status -v
  • storcli show all
  • sas2flash -list
  • sas3flash -list
  • camcontrol devlist
  • smartctl -x /dev/daX for each problem drive

Format each output by either:

  • Using the </> button for formatted text ('CODE"); or
  • Pasting the output between two lines of three backquotes
    ```
    output here
    ```
1 Like
5

Ok many thanks, I’ll replay the outputs cmd when the system ends the scrub activity that I run yesterday morning and is alredy running. now is 70%…
Bye

6

None of these commands will hinder a scrub…

7

Ok, Here the outputs requested:

NAME                                                  STATE     READ WRITE CKSUM
	pool1                                                 DEGRADED     0     0     0
	  raidz2-0                                            DEGRADED     0     0     0
	    gptid/cc5aadbb-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    spare-1                                           DEGRADED     0     0     0
	      5146521994079950617                             REMOVED      0     0     0  was /dev/gptid/de9ec45c-6283-11ee-955b-ac1f6b6c546a
	      gptid/4fbe7aa5-8c05-11e8-99af-ac1f6b6c546a      ONLINE       0     0     0
	    gptid/cdc3a975-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/ce82ed4a-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/cf5efc59-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d027f7c7-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d107d81f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d1fa0b42-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d3152db9-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-1                                            ONLINE       0     0     0
	    gptid/d45023d9-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d546e52f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d6647f24-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d758740e-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d862eefc-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/d9a39724-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/dab6106c-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/dbcc2108-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/dcfb288f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-2                                            ONLINE       0     0     0
	    gptid/de667753-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/dfa0928a-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e0cfab26-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e210aca5-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e3423936-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e47e20be-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/05007245-f04b-11ef-af2c-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e7260672-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/e89466da-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-3                                            ONLINE       0     0     0
	    gptid/ea74ce3f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/ebff1211-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/ed5308ed-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/eebc711e-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/eff0bd2f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/f13bf459-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/f2af7fd7-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/f40ff62f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/f598c60c-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-4                                            ONLINE       0     0     0
	    gptid/f7cc90c1-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/f91e4488-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/fa9592cc-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/fc16ad40-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/fdb76559-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/ff5def5f-8bfe-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/00e4da10-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/026cd507-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/040b1e07-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-5                                            ONLINE       0     0     0
	    gptid/06cdaabe-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/485026f5-8c05-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/0a845950-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/0c774435-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/0e59adc0-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/1050012b-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/121891c4-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/13c6fbb2-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/15684fb1-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-6                                            DEGRADED     0     0     0
	    gptid/1886d4c1-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/9d405b52-4188-11ee-955b-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/1c0ed4b6-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/1dc75dab-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/1f88c305-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    spare-5                                           DEGRADED     0     0     0
	      replacing-0                                     DEGRADED     0     0     0
	        spare-0                                       DEGRADED     0     0     0
	          2952479276134711775                         UNAVAIL      5    40     0  was /dev/gptid/2150c0ad-8bff-11e8-99af-ac1f6b6c546a
	          gptid/4d4741c9-8c05-11e8-99af-ac1f6b6c546a  ONLINE       0     0     0
	        gptid/c5234912-822b-11ef-af2c-ac1f6b6c546a    ONLINE       0     0     0
	      gptid/4adfc88b-8c05-11e8-99af-ac1f6b6c546a      ONLINE       0     0     0
	    gptid/2321d681-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/25258461-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/276a6cb6-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	  raidz2-7                                            ONLINE       0     0     0
	    gptid/2bad86e7-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/2e3838a1-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/303a3f41-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/3237cdff-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/34184d82-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/36171904-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/38234f3f-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/3a20d213-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	    gptid/3c3f9881-8bff-11e8-99af-ac1f6b6c546a        ONLINE       0     0     0
	cache
	  gptid/efcb4e46-8e86-11e8-a211-ac1f6b6c546a          ONLINE       0     0     0
	  gptid/f1116f24-8e86-11e8-a211-ac1f6b6c546a          ONLINE       0     0     0
	spares
	  1452886384188519195                                 INUSE     was /dev/gptid/4adfc88b-8c05-11e8-99af-ac1f6b6c546a
	  3704549270654786752                                 INUSE     was /dev/gptid/4d4741c9-8c05-11e8-99af-ac1f6b6c546a
	  1919800394822298795                                 INUSE     was /dev/gptid/4fbe7aa5-8c05-11e8-99af-ac1f6b6c546a
	  gptid/521d4cfe-8c05-11e8-99af-ac1f6b6c546a          AVAIL   
	  gptid/548f5307-8c05-11e8-99af-ac1f6b6c546a          AVAIL   
	  gptid/5b292af6-e110-11e8-b248-ac1f6b6c546a          AVAIL   

errors: No known data errors
8 
CLI Version = 007.0504.0000.0000 Nov 22, 2017
Operating system = FreeBSD 11.1-STABLE
Status Code = 0
Status = Success
Description = None

Number of Controllers = 0
Host Name = GOKU.cgrspa.local
Operating System  = FreeBSD 11.1-STABLE
StoreLib IT Version = 07.0504.0200.0000


LSI Corporation SAS2 Flash Utility
Version 16.00.00.00 (2013.03.01) 
Copyright (c) 2008-2013 LSI Corporation. All rights reserved 

	No LSI SAS adapters found! Limited Command Set Available!
	ERROR: Command Not allowed without an adapter!
	ERROR: Couldn't Create Command -list
	Exiting Program.



Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02) 
Copyright 2008-2017 Avago Technologies. All rights reserved.

	No Avago SAS adapters found! Limited Command Set Available!
	ERROR: Command Not allowed without an adapter!
	ERROR: Couldn't Create Command -list
	Exiting Program.
9 
<SuperMicro SSD SOB20R>            at scbus4 target 0 lun 0 (pass0,ada0)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 0 (pass1,da0)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 1 (pass2,da1)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 2 (pass3,da2)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 3 (pass4,da3)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 4 (pass5,da4)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 5 (pass6,da5)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 6 (pass7,da6)
<HGST HUS726040ALE610 R001>        at scbus6 target 1 lun 7 (pass8,da7)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 0 (pass9,da8)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 1 (pass10,da9)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 2 (pass11,da10)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 3 (pass12,da11)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 4 (pass13,da12)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 5 (pass14,da13)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 6 (pass15,da14)
<HGST HUS726040ALE610 R001>        at scbus6 target 2 lun 7 (pass16,da15)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 0 (pass17,da16)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 1 (pass18,da17)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 2 (pass19,da18)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 3 (pass20,da19)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 4 (pass21,da20)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 5 (pass22,da21)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 6 (pass23,da22)
<HGST HUS726040ALE610 R001>        at scbus6 target 3 lun 7 (pass24,da23)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 0 (pass25,da24)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 1 (pass26,da25)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 2 (pass27,da26)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 3 (pass28,da27)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 4 (pass29,da28)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 5 (pass30,da29)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 6 (pass31,da30)
<HGST HUS726040ALE610 R001>        at scbus6 target 4 lun 7 (pass32,da31)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 0 (pass33,da32)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 1 (pass34,da33)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 2 (pass35,da34)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 3 (pass36,da35)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 4 (pass37,da36)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 5 (pass38,da37)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 6 (pass39,da38)
<HGST HUS726040ALE610 R001>        at scbus6 target 5 lun 7 (pass40,da39)
<HGST HUS726040AL5210 R001>        at scbus6 target 6 lun 0 (pass41,da40)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 1 (pass42,da41)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 2 (pass43,da42)
<INTEL SSDSC2KG019T7 R001>         at scbus6 target 6 lun 3 (pass44,da43)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 4 (pass45,da44)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 5 (pass46,da45)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 6 (pass47,da46)
<HGST HUS726040ALE610 R001>        at scbus6 target 6 lun 7 (pass48,da47)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 0 (pass49,da48)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 1 (pass50,da49)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 2 (pass51,da50)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 3 (pass52,da51)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 4 (pass53,da52)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 5 (pass54,da53)
<HGST HUS726040ALA610 R001>        at scbus6 target 7 lun 6 (da54,pass55)
<HGST HUS726040ALE610 R001>        at scbus6 target 7 lun 7 (pass56,da55)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 0 (pass57,da56)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 1 (pass58,da57)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 2 (pass59,da58)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 3 (pass60,da59)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 4 (pass61,da60)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 5 (pass62,da61)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 6 (pass63,da62)
<HGST HUS726040ALE610 R001>        at scbus6 target 8 lun 7 (pass64,da63)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 0 (pass65,da64)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 1 (pass66,da65)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 2 (pass67,da66)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 3 (pass68,da67)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 4 (pass69,da68)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 5 (pass70,da69)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 6 (pass71,da70)
<HGST HUS726040ALE610 R001>        at scbus6 target 9 lun 7 (pass72,da71)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 0 (pass73,da72)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 1 (pass74,da73)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 2 (da74,pass75)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 3 (pass76,da75)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 4 (pass77,da76)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 5 (pass78,da77)
<HGST HUS726040ALE610 R001>        at scbus6 target 10 lun 6 (pass79,da78)
<INTEL SSDSC2KG019T7 R001>         at scbus6 target 10 lun 7 (pass80,da79)
<Areca RAID controller R001>       at scbus6 target 16 lun 0 (pass81)
10 
da40=====================
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.1-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040AL5210
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d2068d6fa70
Serial number:        K7H5PZTL
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:38:02 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
/////////////////////////////////

=====================DA54==================
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.1-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALA610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d2075bafcd0
Serial number:        K3GYDWJL
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:36:49 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
///////////////////////////////////////////

=================================DA68=========================
=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALE610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d202a51180c
Serial number:        K7JAX3RB
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:34:37 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
////////////////////////////////////////////////////

======================== da69 ================================
=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALE610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d204c22fa67
Serial number:        K7J485MB
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:35:51 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
////////////////////////////////////////////

===================================DA70=========================

=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALE610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d20d1bbeced
Serial number:        K7J4JZPB
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:33:27 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
//////////////////////////////////////////////////

==========================DA74================================
=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALE610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d20924b9475
Serial number:        K7H6309L
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:32:20 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
//////////////////////////////////////////

==========================DA18============================
=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040ALE610
Revision:             R001
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Rotation Rate:        10000 rpm
Logical Unit id:      0x001b4d20b1cdbacb
Serial number:        K7K7GZYT
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed Mar  5 15:54:29 2025 CET
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported
Read Cache is:        Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     30 C
Drive Trip Temperature:        25 C

Manufactured in week 30 of year 2002
Specified cycle count over device lifetime:  4278190080
Accumulated start-stop cycles:  256
Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0        0         0         0          0          0.000           0
write:         0        0         0         0          0          0.000           0

Non-medium error count:        0

Device does not support Self Test logging
Device does not support Background scan results logging
///////////////////////////////
11

Our dubt is that some spare disk still working/busy also have finished the resilvering… or some spare disks were already fault before start resilvering…
Thanks

12

11.1 is old and long EOL, but I assume you know that.

Ohhh… there’s not much love for these around here. (Cue in music by Ennio Morricone.)
Fibre Channel is an unknown land for most.

Jobe done here. You can remove 5146521994079950617 from Storage > Pool > Status and make the spare a permanent member.

Indeed multiple situation here, a spare has kicked in to replace another spare. Hopefully it should unwind after removing 2952479276134711775.

13

Thanks etorix,

1st case
I’ve already removed red-fixed-light 5146521994079950617 (da74) and after this waited the end of resilver, at the end have inserted into that slot a new disk.
After this, a new resilver is started but at his end, the spare (da70) still seems as locked?

2nd case
When a disk become fault, it starts fixed red-liìght and I can recognize his slot.
Now, all the disks are “happily” blinking with normal activity with blue lights…
Which kind of value indicates 2952479276134711775 in that row of status output ?
How can I find the corrispondence 2952479276134711775<–>slot or dev or gptid? ?
Is possible to force a fixed light or other method, by cmd in order to identify slot location–dev/daxx ?

This gptid raw in status output:
2952479276134711775 “was /dev/gptid/2150c0ad-8bff-11e8-99af-ac1f6b6c546a”
I never find any list or match to other corrispondence like dev daxx ecc…

I’m really jam…

Bye

14

It’s just an internal ZFS identifier, and if you’re seeing it the device is no longer recognised by GPTID or as /dev/da*

If there activity LEDs, creating useless activity while the pool is at rest should do it.
dd of=/dev/null bs=1 count=100 if=/dev/daXX should made the LED blink while reading 100 MB. (Don’t mix if and of!)
With so many drives it won’t be fun.

gpart list should also produce a big list of GPTIDs.