topic Re: Failed Disks in aggregates in ONTAP Hardware

Failed Disks in aggregates

alexthurston — Wed, 04 Jun 2025 23:09:40 GMT

Hello,

Im looking for a little help, we have a FAS3140 as a development san and for restores from an old tape solution, over the past few weeks weve seen around 8 drives fail, one of my collegues has replaced these drives but not assigned them to any pools or aggregates, i know how to assign the disks just not sure how can i check to see how may disks are required in each aggregate and ensure that there is sufficent disks / spares available.

We have 2 aggregates,

aggr0 contains 265 GB FCAL disks

agg1 has 408 GB SAS disks.

Thanks in Advance,

Alex

Re: Failed Disks in aggregates

YIshikawa — Wed, 30 Sep 2015 13:02:21 GMT

"sysconfig -r" shows RAID configuration and spare disks. You may be able to know each RAID groups have sufficient healthy disks, but if wonder, please post its output here.

Re: Failed Disks in aggregates

alexthurston — Wed, 30 Sep 2015 14:05:41 GMT

sysconfig -r
Aggregate aggr1 (online, raid_dp) (block checksums)
Plex /aggr1/plex0 (online, normal, active)
RAID group /aggr1/plex0/rg0 (normal, block checksums)

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 2c.125L1 2c 1 0 FC:B 0 SAS 15000 418000/856064000 420584/861357448
parity 1c.125L2 1c 1 1 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L3 1c 1 2 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L4 1c 1 3 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L5 2c 1 4 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L6 2c 1 5 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L7 1c 1 6 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L8 2c 1 7 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L9 2c 1 8 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L10 1c 1 9 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L11 2c 1 10 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L12 1c 1 11 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L13 1c 1 12 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L14 2c 1 13 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L15 1c 1 14 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L16 1c 1 15 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L17 2c 1 16 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L18 1c 1 17 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L19 1c 1 18 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L20 2c 1 19 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L21 2c 1 20 FC:B 0 SAS 15000 418000/856064000 420584/861357448
data 1c.125L22 1c 1 21 FC:A 0 SAS 15000 418000/856064000 420584/861357448
data 2c.125L23 2c 1 22 FC:B 0 SAS 15000 418000/856064000 420584/861357448

Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active)
RAID group /aggr0/plex0/rg0 (normal, block checksums)

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 1a.16 1a 1 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
parity 1a.32 1a 2 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.48 1a 3 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.64 2a 4 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.80 1a 5 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.96 2a 6 0 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.17 2a 1 1 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.97 2a 6 1 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.33 2a 2 1 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.65 2a 4 1 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.81 2a 5 1 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 1a.98 1a 6 2 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.18 1a 1 2 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.50 1a 3 2 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.35 1a 2 3 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.66 2a 4 2 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.82 2a 5 2 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.99 1a 6 3 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.19 1a 1 3 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.51 1a 3 3 FC:A 0 FCAL 15000 272000/557056000 280104/573653840

RAID group /aggr0/plex0/rg1 (normal, block checksums)

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 1a.27 1a 1 11 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
parity 1a.52 1a 3 4 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.83 1a 5 3 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 1a.38 1a 2 6 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.20 2a 1 4 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.67 2a 4 3 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.101 1a 6 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.53 2a 3 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.84 1a 5 4 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.37 2a 2 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.21 1a 1 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.68 2a 4 4 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.105 2a 6 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.54 1a 3 6 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.85 2a 5 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.34 1a 2 2 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.22 2a 1 6 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.69 1a 4 5 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.103 1a 6 7 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.55 1a 3 7 FC:A 0 FCAL 15000 272000/557056000 280104/573653840

RAID group /aggr0/plex0/rg2 (normal, block checksums)

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 2a.86 2a 5 6 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
parity 2a.56 2a 3 8 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.39 2a 2 7 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.23 2a 1 7 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.70 1a 4 6 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.104 2a 6 8 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.87 1a 5 7 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.57 2a 3 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.40 1a 2 8 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.24 1a 1 8 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.71 2a 4 7 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 1a.36 1a 2 4 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 1a.88 1a 5 8 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.58 1a 3 10 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.41 1a 2 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.25 2a 1 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.73 2a 4 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.106 1a 6 10 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.89 2a 5 9 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.59 1a 3 11 FC:A 0 FCAL 15000 272000/557056000 280104/573653840

RAID group /aggr0/plex0/rg3 (normal, block checksums)

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 2a.42 2a 2 10 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
parity 1a.60 1a 3 12 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.26 2a 1 10 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.90 2a 5 10 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.74 1a 4 10 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.107 1a 6 11 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.43 2a 2 11 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.61 2a 3 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.72 2a 4 8 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.91 2a 5 11 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.49 1a 3 1 FC:A 0 FCAL 15000 272000/557056000 274845/562884296
data 2a.109 2a 6 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.44 1a 2 12 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.28 2a 1 12 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.92 2a 5 12 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.76 2a 4 12 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.45 2a 2 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.29 2a 1 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 2a.93 2a 5 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840
data 1a.77 1a 4 13 FC:A 0 FCAL 15000 272000/557056000 280104/573653840

Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 1a.100 1a 6 4 FC:A 0 FCAL 15000 272000/557056000 274845/562884296 (not zeroed)
spare 2a.102 2a 6 6 FC:A 0 FCAL 15000 272000/557056000 274845/562884296 (not zeroed)
spare 2a.108 2a 6 12 FC:A 0 FCAL 15000 272000/557056000 274845/562884296 (not zeroed)
spare 2a.75 2a 4 11 FC:A 0 FCAL 15000 272000/557056000 280104/573653840 (not zeroed)
spare 2c.125L24 2c 1 23 FC:B 0 SAS 15000 418000/856064000 420584/861357448

to me it looks like all the raid groups are in pool 0 and there are spare disks available do we need to assign these or will they be picked up automatically?

Thanks

Re: Failed Disks in aggregates

alexthurston — Wed, 30 Sep 2015 14:55:39 GMT

sysconfig -r
Aggregate aggr1 (online, raid_dp) (block checksums)
Plex /aggr1/plex0 (online, normal, active)
RAID group /aggr1/plex0/rg0 (normal, block checksums)

Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active)
RAID group /aggr0/plex0/rg0 (normal, block checksums)

RAID group /aggr0/plex0/rg1 (normal, block checksums)

RAID group /aggr0/plex0/rg2 (normal, block checksums)

RAID group /aggr0/plex0/rg3 (normal, block checksums)

Pool1 spare disks (empty)

Pool0 spare disks

to me it looks like all the raid groups are in pool 0 and there are spare disks available do we need to assign these or will they be picked up automatically?

Thanks

Re: Failed Disks in aggregates

YIshikawa — Mon, 05 Oct 2015 23:27:03 GMT

No failed or missing disks now. All the disks in RAID groups and spare disks are in pool 0.

Pool 1 is used only in SynMirror in which data is mirrored between plex 0 and plex 1, so you don't need to mind empty pool 1 spare.