Strange: 3 out of 4 SATA connections failed?

Today I found my NAS failed somehow:
The SMB server wasn’t responding so I logged into the SCALE ui and it showed the pool unavailable.
I didn’t took a screenshot but two disks were marked as unavailable and one as removed. In the console messages I saw some SATA connection(s?) degraded to 1.5 Gb.
I took a screenshot from the BMC. ata4 must be the connection where the disk is shown as “removed”. I shut the system down and opend the case but nothing unusual to see.

Should I just boot the system and see how it goes?

The system:
4x 12 TB @ RAIDZ2 on a Supermicro X11SCL-F

Are they connected by individual sata cables, are they on the same controller?

The system is build inside a Inter-Tech 2404S (S = short) enclosure.

It is build to use with SAS but there is a cable to use it with SATA drives:

The SATA cables are connected to the onboard controller.
Is “feels” like a hardware related problem because the system was running for 3-4 years now without any bigger problems (once a HDD failed and the migration from CORE to SCALE wasn’t that smooth).

Actually, yes. You need to start somewhere.

in the meantime, a few questions might be nice to ask:

  1. Are the fans all spinning inside the computer (includes the power supply)?
  2. Did you recently (in the past week) change TrueNAS software?
  3. Are you running TrueNAS on bare metal?
  4. How much RAM do you have? (this should have no bearing on your problem, I just like asking it)
  5. Have you done anything to the system (move it, open/close it, etc,) in the past week?
  6. Do you have any spare SATA cables? You may need them. These cables go bad when they feel like it and there seems to be no reason for it, other than possibly bad manufacturing.

Post what happens when you power on the system. Hopefully you will recover your pool without issue.

EDIT: If you do not have a new SATA cable, unplug it and plug it back in, both sides. I think that motherboard has SATA ports as well, you can use those with normal SATA cables.

1: All fans are spinning.
2 + 5: nothing changed in the past weeks. I changed the configuration of the snapshots ~4 weeks ago.
3: TrueNAS is running on bare metal.
4: 64 GB (2x 32 GB DDR4-2666 ECC).
6: yes but I need that specific adapter cable to use it in this enclosure.

I reconnected the SFF-8087 cable and booted the system:
In the Disk overview now all disks are shown like nothing happend but the pool is offline and the disks show “pool name (exported)”.
I can just (re-)import the pool and it should work, right?

Edit: If i click on “Import Pool” I cannot choose the pool. The storage dashboard shows “Disk with exported pools: 4”. Do I need to click on “Add to Pool” here?

Check your power supply before doing anything else. Power supplies are the #2 failure cause. I’ve hat strange disk errors in my spare nas that went away after upgrading the power supply for a stronger one. (200W → 500W Flex-ATX)

I use a redundant, hot-plugable 2x 550W server power supply and a USV. I really don’t need to worry about the power. (this is way to much but it was the “smallest” redundant power supply available back then)

Actual state: