NetApp 8.1 Disk won't add as spare, remains in Present state

ips104 · ‎2022-03-25

We recently had a spare disk die and we replaced with from a 3rd party provider from another system. While the system does see the disk, it remains in the 'Present' State on the CLI. The new disk has the same owner as the other disks.

When trying to add the disk to our aggregate, it says there are no spare disks available. I've gone through a bunch of forum posts but been unable to find the exact solution to get this added back in as a spare and seeking some help.

NetApp Release 8.1.4P10 7-Mode

paul_stejskal · ‎2022-03-28

What do you mean "from another system"? Was ownership removed? That's the only thing I could think of where it might not work.

ips104 · ‎2022-03-28

Bad wording on my part. It was a 3rd party purchase to get an older NetApp drive that would work with our older system. The ownership has been removed and set to match the other disks, however that didn't solve the issue when trying to add.

paul_stejskal · ‎2022-03-28

Do you have some outputs from the system? Maybe start with a sysconfig -a, disk show?

ips104 · ‎2022-03-30

Yes, definitely. 0b.01.10 is the new disk I am trying to add to the aggregate.

na1> disk show
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
0b.01.1 na1 (1787972974) Pool0 J9WXBGTL na1 (1787972974)
0b.01.10 na1 (1787972974) Pool0 2AWZXUGN na1 (1787972974)
0b.01.2 na1 (1787972974) Pool0 J9X24B0L na1 (1787972974)
0b.01.4 na1 (1787972974) Pool0 WFJ381ZT na1 (1787972974)
0b.01.3 na1 (1787972974) Pool0 J9X1U2ML na1 (1787972974)
0b.01.0 na1 (1787972974) Pool0 J9X0JEWL na1 (1787972974)
0b.01.8 na1 (1787972974) Pool0 WFJ382G0 na1 (1787972974)
0b.01.9 na1 (1787972974) Pool0 J9X2A3TL na1 (1787972974)
0a.00.11 na2 (1884101334) Pool0 WD-WMAY02884548 na2 (1884101334)
0a.00.5 na2 (1884101334) Pool0 WD-WMAY03959598 na2 (1884101334)
0b.01.7 na1 (1787972974) Pool0 2AWK83RN na1 (1787972974)
0a.00.10 na2 (1884101334) Pool0 WD-WMAY03962890 na2 (1884101334)
0b.01.11 na1 (1787972974) Pool0 J9X1Y71L na1 (1787972974)
0a.00.6 na2 (1884101334) Pool0 WD-WMAY02885081 na2 (1884101334)
0a.00.7 na2 (1884101334) Pool0 WD-WMAY03959475 na2 (1884101334)
0a.00.3 na2 (1884101334) Pool0 WD-WMAY02883929 na2 (1884101334)
0a.00.2 na2 (1884101334) Pool0 WD-WMAY03962891 na2 (1884101334)
0a.00.8 na2 (1884101334) Pool0 WD-WMAY04000999 na2 (1884101334)
0a.00.1 na2 (1884101334) Pool0 WD-WMAY03955268 na2 (1884101334)
0a.00.9 na2 (1884101334) Pool0 WD-WMAY02883970 na2 (1884101334)
0a.00.4 na2 (1884101334) Pool0 WD-WMAY02883926 na2 (1884101334)
0a.00.0 na2 (1884101334) Pool0 WD-WMAY02883775 na2 (1884101334)
0b.01.5 na1 (1787972974) Pool0 J9X1D1GL na1 (1787972974)
0b.01.6 na1 (1787972974) Pool0 WFJ3PNDQ na1 (1787972974)

na1> sysconfig -a
NetApp Release 8.1.4P10 7-Mode: Fri Nov 11 22:59:59 PST 2016
System ID: 1787972974 (na1); partner ID: 1884101334 (na2)
System Serial Number: 700000946092 (na1)
System Rev: B1
System Storage Configuration: Multi-Path HA
System ACP Connectivity: Full Connectivity
slot 0: System Board 1.7 GHz (System Board XIX B1)
Model Name: FAS2240-4
Part Number: 111-00846
Revision: B1
Serial Number: 5009198446
BIOS version: 8.2.0
Loader version: 4.2
Processors: 4
Processor ID: 0x106e4
Microcode Version: 0xffff0002
Processor type: Intel(R) Xeon(R) CPU C3528 @ 1.73GHz
Memory Size: 6144 MB
Memory Attributes: Hoisting
Normal ECC
NVMEM Size: 768 MB of Main Memory Used
CMOS RAM Status: OK
Controller: A
Service Processor Status: Online
Firmware Version: 2.1.3P2
Mgmt MAC Address: 00:A0:98:19:A1:F2
Ethernet Link: up, 100Mb, full duplex, auto-neg complete
Using DHCP: no
IPv4 configuration:
IP Address: 192.168.111.200
Netmask: 255.255.255.0
Gateway: 192.168.111.1
IPv6 configuration: Disabled
slot 0: Internal 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:19:a1:f1 (auto-100tx-fd-up)
e0P MAC Address: 00:a0:98:19:a1:f0 (auto-100tx-fd-up)
Device Type: Rev 0
memory mapped I/O base 0x00000000dfb20000, size 0x20000
I/O base 0x0000000000003000, size 0x20
memory mapped I/O base 0x00000000dfb00000, size 0x4000
memory mapped I/O base 0x00000000dfc00000, size 0x20000
I/O base 0x0000000000004000, size 0x20
memory mapped I/O base 0x00000000dfc20000, size 0x4000
slot 0: Quad Gigabit Ethernet Controller 82580
e0a MAC Address: 00:a0:98:19:a1:ec (auto-1000t-fd-up)
e0b MAC Address: 00:a0:98:19:a1:ed (auto-1000t-fd-up)
e0c MAC Address: 00:a0:98:19:a1:ee (auto-1000t-fd-up)
e0d MAC Address: 00:a0:98:19:a1:ef (auto-1000t-fd-up)
Device Type: 150E
memory mapped I/O base 0x00000000df900000, size 0x80000
I/O base 0x0000000000002040, size 0x20
memory mapped I/O base 0x00000000dfa08000, size 0x4000
memory mapped I/O base 0x00000000df980000, size 0x80000
I/O base 0x0000000000002060, size 0x20
memory mapped I/O base 0x00000000dfa0c000, size 0x4000
memory mapped I/O base 0x00000000df800000, size 0x80000
I/O base 0x0000000000002000, size 0x20
memory mapped I/O base 0x00000000dfa00000, size 0x4000
memory mapped I/O base 0x00000000df880000, size 0x80000
I/O base 0x0000000000002020, size 0x20
memory mapped I/O base 0x00000000dfa04000, size 0x4000
slot 0: Interconnect HBA: Mellanox IB MT25204
GUID: 0x100000a09819a1ec LID: 0x4 Remote LID: 0x5
Firmware rev: 1.0.800
Hardware rev: 160
Command rev: 1
Cluster Interconnect Port: 4x
memory mapped I/O base 0xdf400000, size 0x100000
prefetchable memory base 0xde800000, size 0x800000
slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)
Firmware rev: 01.11.07.00
Base WWN: 5:00a098:000865c:30
Phy State: [0] Enabled, 6.0 Gb/s
[1] Enabled, 6.0 Gb/s
[2] Enabled, 6.0 Gb/s
[3] Enabled, 6.0 Gb/s
00.0 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883775)
00.1 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03955268)
00.2 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03962891)
00.3 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883929)
00.4 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883926)
00.5 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03959598)
00.6 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02885081)
00.7 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03959475)
00.8 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY04000999)
00.9 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883970)
00.10: NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03962890)
00.11: NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02884548)
01.0 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X0JEWL)
01.1 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9WXBGTL)
01.2 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X24B0L)
01.3 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1U2ML)
01.4 : NETAPP X412_SSKBE560A15 NA01 560.0GB 520B/sect (WFJ381ZT)
01.5 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1D1GL)
01.6 : NETAPP X412_SSKBE560A15 NA02 560.0GB 520B/sect (WFJ3PNDQ)
01.7 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (2AWK83RN)
01.8 : NETAPP X412_SSKBE560A15 NA01 560.0GB 520B/sect (WFJ382G0)
01.9 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X2A3TL)
01.10: NETAPP X412_HVIPC560A15 NA03 560.0GB 520B/sect (2AWZXUGN)
01.11: NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1Y71L)
Shelf 0: IOM6E Firmware rev. IOM6E A: 0172 IOM6E B: 0172
Shelf 1: IOM3 Firmware rev. IOM3 A: 0212 IOM3 B: 0212
slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <UP>)
Firmware rev: 01.11.07.00
Base WWN: 5:00a098:000865c:34
Phy State: [4] Enabled, 3.0 Gb/s
[5] Enabled, 3.0 Gb/s
[6] Enabled, 3.0 Gb/s
[7] Enabled, 3.0 Gb/s
QSFP Vendor: Molex Inc.
QSFP Part Number: 112-00177+A0
QSFP Type: Passive Copper 2m ID:01
QSFP Serial Number: 203020477
00.0 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883775)
00.1 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03955268)
00.2 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03962891)
00.3 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883929)
00.4 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883926)
00.5 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03959598)
00.6 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02885081)
00.7 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03959475)
00.8 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY04000999)
00.9 : NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02883970)
00.10: NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY03962890)
00.11: NETAPP X306_WMANT02TSSA NA02 1695.4GB 512B/sect (WD-WMAY02884548)
01.0 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X0JEWL)
01.1 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9WXBGTL)
01.2 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X24B0L)
01.3 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1U2ML)
01.4 : NETAPP X412_SSKBE560A15 NA01 560.0GB 520B/sect (WFJ381ZT)
01.5 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1D1GL)
01.6 : NETAPP X412_SSKBE560A15 NA02 560.0GB 520B/sect (WFJ3PNDQ)
01.7 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (2AWK83RN)
01.8 : NETAPP X412_SSKBE560A15 NA01 560.0GB 520B/sect (WFJ382G0)
01.9 : NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X2A3TL)
01.10: NETAPP X412_HVIPC560A15 NA03 560.0GB 520B/sect (2AWZXUGN)
01.11: NETAPP X412_HVIPC560A15 NA04 560.0GB 520B/sect (J9X1Y71L)
Shelf 0: IOM6E Firmware rev. IOM6E A: 0172 IOM6E B: 0172
Shelf 1: IOM3 Firmware rev. IOM3 A: 0212 IOM3 B: 0212
memory mapped I/O base 0xdf530000, size 0x10000
memory mapped I/O base 0xdf520000, size 0x10000
memory mapped I/O base 0x00000000df510000, size 0x10000
memory mapped I/O base 0x00000000df500000, size 0x10000

Mjizzini · ‎2022-04-01

When the raid.disktype.enable option is set to off, you can mix certain types of HDDs within the same aggregate

How you can use effective ONTAP disk type for mixing HDDs

ips104 · ‎2022-04-04

What would be the command to enable that option?

As well, where in that output did you see that the disk was different. I've run through the list a few times and can't find what that cause would be.

Thank you.

Mjizzini · ‎2022-04-07

::*> node run nodename options raid.disktype.enable <on/off>
::*> node run nodename options raid.mix.hdd.disktype.capacity <on/off>
::*> node run nodename options raid.mix.hdd.disktype.performance <on/off>

ips104 · ‎2022-04-13

I may be missing something there still, as that command does not work. No Node commands are functioning

na1> node run nodename options raid.disktype.enable
node not found. Type '?' for a list of commands

darb0505 · ‎2022-04-13

@ips104,

It would be the following command:

na1>options raid.disktype.enable <on/off>
na1>options raid.mix.hdd.disktype.capacity <on/off>
na1>options raid.mix.hdd.disktype.performance <on/off>

Thanks,

Brad

Team NetApp

ips104 · ‎2022-04-14

Thank you Brad, I was able to run those commands and verify that disktype enable option was off, so I don't believe that was the issue I was running into when trying to add this disk to the aggregate.

So unfortunately still in the same spot.

darb0505 · ‎2022-04-14

@ips104,

Here is some more information for you on those commands. Man Pages Link

===================

raid.disktype.enable
This option is obsolete. Use options raid.mix.hdd.disktype.capacity and raid.mix.hdd.disktype.performance instead.

raid.mix.hdd.disktype.performance
Controls mixing of FCAL and SAS disk types. The default value is off, which prevents mixing.

If you set this option to on, FCAL and SAS disk types are considered interchangeable for all aggregate operations, including aggregate creation, adding disks to an aggregate, and replacing disks within an existing aggregate, whether this is done by the administrator or automatically by Data ONTAP.

When this option is set to off, FCAL and SAS disks cannot be combined within the same aggregate. If you have existing aggregates that combine those disk types, those aggregates will continue to function normally and accept either disk type.

raid.mix.hdd.disktype.capacity
Controls mixing of SATA, BSAS, FSAS and ATA disk types. The default value is on, which allows mixing.

When this option is set to on, SATA, BSAS, FSAS and ATA disk types are considered interchangeable for all aggregate operations, including aggregate creation, adding disks to an aggregate, and replacing disks within an existing aggregate, whether this is done by the administrator or automatically by Data ONTAP.

If you set this option to off, SATA, BSAS, FSAS and ATA disks cannot be combined within the same aggregate. If you have existing aggregates that combine those disk types, those aggregates will continue to function normally and accept any of those disk types.

So you will want to to have the disktype.capacity to be ON. If you are using FCAL/SAS disks you will need to turn on the disktype.performance option.

Thanks,

Brad

Team NetApp

ips104 · ‎2022-04-18

Looking into this from a few other directions, I found that the disk is only reporting 20MB effective size on the the 547.73gb physical space on the disk.

As well, I think the firmware may be outdated, based off this output. The disks seem to be on a variety of revision numbers? Am I on the right track here?

DISK SHELF BAY SERIAL VENDOR MODEL REV TYPE
--------------------- --------- ---------------- -------- ---------- ---- ------
0b.01.0 1 0 J9X0JEWL NETAPP X412_HVIPC NA04 SAS
0b.01.1 1 1 J9WXBGTL NETAPP X412_HVIPC NA04 SAS
0b.01.2 1 2 J9X24B0L NETAPP X412_HVIPC NA04 SAS
0b.01.3 1 3 J9X1U2ML NETAPP X412_HVIPC NA04 SAS
0b.01.4 1 4 WFJ381ZT NETAPP X412_SSKBE NA01 SAS
0b.01.5 1 5 J9X1D1GL NETAPP X412_HVIPC NA04 SAS
0b.01.6 1 6 WFJ3PNDQ NETAPP X412_SSKBE NA02 SAS
0b.01.7 1 7 2AWK83RN NETAPP X412_HVIPC NA04 SAS
0b.01.8 1 8 WFJ382G0 NETAPP X412_SSKBE NA01 SAS
0b.01.9 1 9 J9X2A3TL NETAPP X412_HVIPC NA04 SAS
0b.01.10 1 10 2AWZXUGN NETAPP X412_HVIPC NA03 SAS
0b.01.11 1 11 J9X1Y71L NETAPP X412_HVIPC NA04 SAS

darb0505 · ‎2022-04-18

@ips104,

You are on the right track. I would look at the disk drive & firmware matrix. Also verify you have the latest Disk Qualification package.

Let us know if you have any follow up questions.

Thanks

Brad

Team NetApp