Solved: Add a disk as a spare to an aggregate

Nil · ‎2015-09-02

Hello,

I need some help.

The system is running DataONtap 8.1.4P8 7-Mode, on a FAS3240

I need to add a spare disk to an aggregate, this aggregates is the only aggregates with 3TB SAS disks, I have other aggregates with 600GB SAS and 1 TB SATA disks.

I want to ensure physically adding the drive will not assign the disk as data drive into the 3TB aggregate ( called aggr3_sata_svault1 ) or any other aggregate as I want it to be a spare.

Currently disk auto assign is enable, should I turn this of first?

disk.auto_assign on

The aggregate in question as 5 data disks and two parity,(shown in the sysconfig -r output below) however the aggr options command shows the number of disks in the raid group as 14, should I set this to a lower number ie 7 to ensure the disk is not added as a data drive, is shrinking the raid size even possible/supported.

aggr options aggr3_sata_svault1
nosnap=on, raidtype=raid_dp, raidsize=14, ignore_inconsistent=off,
snapmirrored=off, resyncsnaptime=60, fs_size_fixed=off,
snapshot_autodelete=on, lost_write_protect=on, ha_policy=cfo,
hybrid_enabled=off, percent_snapshot_space=0%, free_space_realloc=off

How can I ensure the disk is added only as spare, any response is much appreciated.

Sysconfig -r shown below (section is blue is the aggregate I wish to add a spare disk to)

XXXdrfas01*> sysconfig -r
Aggregate aggr0_sas (online, raid_dp) (block checksums)
Plex /aggr0_sas/plex0 (online, normal, active, pool0)
RAID group /aggr0_sas/plex0/rg0 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0a.01.0         0a    1   0   SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      parity    0b.01.1         0b    1   1   SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.2         0a    1   2   SA:A   0   SAS 15000 560000/1146880000 560879/1148681096
      data      0b.01.23        0b    1   23 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.4         0a    1   4   SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.5         0b    1   5   SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.6         0a    1   6   SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.7         0b    1   7   SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.8         0a    1   8   SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.9         0b    1   9   SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.10        0a    1   10 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.11        0b    1   11 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.12        0a    1   12 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.13        0b    1   13 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.14        0a    1   14 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.15        0b    1   15 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.16        0a    1   16 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.17        0b    1   17 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.18        0a    1   18 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.19        0b    1   19 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.20        0a    1   20 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0b.01.21        0b    1   21 SA:B   0   SAS 15000 560000/1146880000 560208/1147307688
      data      0a.01.22        0a    1   22 SA:A   0   SAS 15000 560000/1146880000 560208/1147307688

Aggregate aggr1_sata (online, raid_dp) (block checksums)
Plex /aggr1_sata/plex0 (online, normal, active, pool0)
RAID group /aggr1_sata/plex0/rg0 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0b.02.9         0b    2   9   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      parity    0a.02.8         0a    2   8   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.7         0b    2   7   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.6         0a    2   6   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.0         0a    3   0   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.4         0a    2   4   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.10        0a    3   10 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.2         0a    2   2   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.1         0b    2   1   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.19        0b    2   19 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.18        0a    2   18 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.17        0b    2   17 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.16        0a    2   16 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.15        0b    2   15 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.14        0a    2   14 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.22        0a    2   22 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.21        0b    2   21 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816

RAID group /aggr1_sata/plex0/rg1 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0b.02.13        0b    2   13 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      parity    0a.02.20        0a    2   20 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.12        0a    2   12 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.11        0b    2   11 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.10        0a    2   10 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.02.0         0a    2   0   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.11        0b    4   11 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.1         0b    3   1   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.2         0a    3   2   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.3         0b    3   3   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.4         0a    3   4   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.5         0b    3   5   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.6         0a    3   6   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.7         0b    3   7   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.8         0a    3   8   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.15        0b    3   15 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.23        0b    4   23 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816

RAID group /aggr1_sata/plex0/rg2 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0a.05.0         0a    5   0   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      parity    0b.03.23        0b    3   23 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.5         0b    2   5   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.1         0b    5   1   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.23        0b    2   23 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.2         0a    5   2   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.3         0b    5   3   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.4         0a    5   4   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.14        0a    5   14 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.6         0a    5   6   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.7         0b    5   7   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.8         0a    5   8   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.9         0b    5   9   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.10        0a    5   10 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.11        0b    5   11 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.05.12        0a    5   12 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.13        0b    5   13 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816

Aggregate aggr2_sata_svault (online, raid_dp) (block checksums)
Plex /aggr2_sata_svault/plex0 (online, normal, active, pool0)
RAID group /aggr2_sata_svault/plex0/rg0 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0a.04.0         0a    4   0   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      parity    0b.04.1         0b    4   1   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.2         0a    4   2   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.3         0b    4   3   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.4         0a    4   4   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.5         0b    4   5   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.6         0a    4   6   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.7         0b    4   7   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.19        0b    3   19 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.18        0a    3   18 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.22        0a    3   22 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.17        0b    3   17 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.21        0b    3   21 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.20        0a    3   20 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.16        0a    3   16 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.5         0b    5   5   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.03.14        0a    3   14 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.8         0a    4   8   SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816

RAID group /aggr2_sata_svault/plex0/rg1 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0b.03.13        0b    3   13 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      parity    0a.03.12        0a    3   12 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.03.11        0b    3   11 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.9         0b    4   9   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.10        0a    4   10 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.05.15        0b    5   15 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.02.3         0b    2   3   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.13        0b    4   13 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.14        0a    4   14 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.15        0b    4   15 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.16        0a    4   16 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.17        0b    4   17 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.18        0a    4   18 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.19        0b    4   19 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.20        0a    4   20 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0b.04.21        0b    4   21 SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816
      data      0a.04.22        0a    4   22 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816

Aggregate aggr3_sata_svault1 (online, raid_dp) (block checksums)
Plex /aggr3_sata_svault1/plex0 (online, normal, active, pool0)
RAID group /aggr3_sata_svault1/plex0/rg0 (normal, block checksums)

      RAID Disk Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
      --------- ------          ------------- ---- ---- ---- ----- --------------    --------------
      dparity   0a.05.22        0a    5   22 SA:A   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      parity    0b.05.21        0b    5   21 SA:B   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      data      0a.05.20        0a    5   20 SA:A   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      data      0b.05.19        0b    5   19 SA:B   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      data      0a.05.18        0a    5   18 SA:A   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      data      0b.05.17        0b    5   17 SA:B   0 BSAS 7200 2538546/5198943744 2543634/5209362816
      data      0a.05.16        0a    5   16 SA:A   0 BSAS 7200 2538546/5198943744 2543634/5209362816

Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk       Device          HA SHELF BAY CHAN Pool Type RPM Used (MB/blks)    Phys (MB/blks)
---------       ------          ------------- ---- ---- ---- ----- --------------    --------------
Spare disks for block checksum
spare           0b.01.3         0b    1   3   SA:B   0   SAS 15000 560000/1146880000 560879/1148681096
spare           0a.04.12        0a    4   12 SA:A   0 BSAS 7200 847555/1735794176 847884/1736466816
spare           0b.03.9         0b    3   9   SA:B   0 BSAS 7200 847555/1735794176 847884/1736466816

richard_payne · ‎2015-09-02

You don't add space disks to aggregates. Aggrs consist only of data and parity drives. Spaces exist in the spares pool and will be called on IF a data/parity drive fails. As for the RAID size value. Yes you can change that if you want, however OnTap will not pull a spare disk into the aggregate, only a human will do that. In other words, OnTap will not grow the aggregate just because it has spares and the RAID size is greater than the allocated drive.

disk.auto_assign will assign an unknown disk to a file server. Each disk is owned by one of the heads in an HA pair and this just means that when an unknown disk is inserted it will be automatically assigned to one of the controller. It does not mean that an unused (spare) disk will be automatically added to an aggregate.

--rdp

View solution in original post

Nil · ‎2015-09-02

Richard Thank you for the reply.

If am understanding your response correctly when I add the new disk it will be automatically added to a pool consisting of spares, thus achieving my goal of just getting an extra spare into the system.

Just to clarify on the disk.auto_assign, if a drive fails it will always use a spare regardless of the disk.auto_assign setting. If the disk.auto_assign is off and a replacement for a failed drive is inserted it will stay un-owned until manually assigned and as the drive is a replacement for a failed drive that has been already added into the aggregate the replacement drive will appear as spare.

Have I understood correctly?

Many thanks

Nil

richard_payne · ‎2015-09-02

"when I add the new disk it will be automatically added to a pool consisting of spares"

When you add a new disk? Meaning if you add a shelf or add disks to a partial filled shelf, then yes.

"if a drive fails it will always use a spare regardless of the disk.auto_assign setting"

Yes

"If the disk.auto_assign is off and a replacement for a failed drive is inserted it will stay un-owned"

Yes, assuming we're talking about software based disk ownership. I think if you're working under hardware based ownership then this has no affect and the drive will get auto assigned to the controller that owns the shelf.

"until manually assigned and as the drive is a replacement for a failed drive that has been already added into the aggregate the replacement drive will appear as spare."

Yes, that's correct. BTW you can see unknowned drives via 'disk show -n'

Hope that helps.

--rdp

TonyWu · ‎2015-09-04

Good to know it

Nil · ‎2015-09-04

I recently physically inserted the drive into an empty bay slot, and the drive appeared as an un-owned disk, I then run the command disk assign and it made the drive spare.

Thank you for reponses, they were spot on.

Nil · ‎2015-09-04

I recently physically inserted the drive into an empty bay slot, and the drive appeared as an un-owned disk, I then run the command disk assign and it made the drive spare.
Thank you for reponses, they were spot on.

Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate

Re: Add a disk as a spare to an aggregate