FAS6210 no drives found after cabling

[Jelle]

Hello!

I recently got a FAS6210 controller (Single controller) with various disk shelves.

I am trying to connect just one shelf, but when the system has booted it tells me that no drives has been found and system will reboot.

I have been looking at cabling guides but none actually describe a single chassis with a single controller in it.

This is a lot of 6 3.5" shelves and 2 FAS6210 chassis both with just one controller. I got a bunch of FC to SAS converters with the lot as well.

As far as I can see I need to use a converter from 8G fibre to 6G SAS and use 0a FC port and route the SAS cable from the converter into the square of the disk shelf.

I have also tried to take a SAS cable from the controller to the bottom IO module on the disk shelf, it shows no link.

Whenever the connection type error pops up I can see the link LED flash both in the converter and on the controller.

I have attached various pictures to help show what I have done.

Any help would be greatly appreciated!

[aborzenkov]

It sounds like you got metrocluster. I strongly recommend you to arrange for professional service from NetApp or partner. Setting up metrocluster needs some experience and far exceeds forum format.

[Jelle]

Thank you for your answer aborzenkov!

I can change the setup to suit any easy setup as I have a second controller and various drive shelves, but I am not sure how to actually cable it as the diagrams seems quite complicated.

I am very familiar with IBM and HP systems, this is my first try on NetApp.

If I can change anything to make it easier for me to setup I would like to know.

Maybe just adding an additional shelf can help?

EDIT:

OK, I have spend some time researching what MetroCluster actually is, and it seems like the FAS6210 I have can't be configured any other way.

I don't care about data, preferably I could wipe the whole setup to make a new one. Is there a way of doing that without having to set up a full MetroCluster and just make one controller see one disk shelf?

If not I found this: https://library.netapp.com/ecm/ecm_download_file/ECMM1280255

Which I think can guide me through setting up the whole thing. I believe configuration should still be active in the system with this kind of setup.

Just weird I got 14 FC bridges with 2 chassis and 6 disk shelves, I can't see what I need that many for.

[AlexDawson · Accepted solution]

I agree with the other poster - it's probably a former metrocluster node. 

For an UNSUPPORTED process to turn it back into a standalone mode:

1. - Shut down system
2. - Remove FCVI card from slot 6
3. - Ensure NVRAM8 card (large battery pack) is in slot 2
4. - Connect serial cable
5. - Power on system
6. - Immediately after RAM test, press control-C and you should be at a LOADER A> prompt
7. - type: set-defaults <enter> bye
8. - System reboots.
9. - Press control-C again "Loading Data ONTAP" - this will bring up a boot menu
10. - Choose option 5 - Maintenance mode boot
11. - In maintenance mode, run "ha-config show" - and it should show "mcc". Run "ha-config modify" and set to "non-ha"
12. - Halt the system
13. - Cable SAS shelves directly to controller
14. - Boot into diagnostics again
15. - Run "disk show" and then "disk removeowner", then "disk assign"
16. - Reboot from maintenance mode, load boot menu again, choose option 4 - wipe config
17. - Reboot again, disks will format in parallel (8hrs/3TB), shows lots of dots
18. - At the end, system will go into setup mode

.. but once you get here, you'll need licenses, which are node-locked, and non-transferrable. So you'll be able to play with aggregate creation, volume creation, network port config, but no protocols will work.

[Jelle]

Hello Alex!

Thank you for your post, it seems like this should be a solution.

Sorry for late reply, I have been lying sick like most people these days.

But what about the licenses? What licenses would I need? Is the system going to be unusable if I follow your steps?

I would just like to be able to create a storage pool and initialize/format the drives. They are all 300GB 15K so it shouldn't take too long.

Thanks for all your help!

EDIT:

OK so I tried your steps. ha-config show did show non-ha and not mcc but I ran it anyway.

I tried cabling the disk shelf via SAS to the controller, this results in no disks shown with disk show.

I also tried using fibre channel and the bridge, this results again in the connection type error being spammed until I remove the cable.

What do I do from here?

[AlexDawson]

Our systems require licenses to enable any storage protocol - and they are non-transferrable, and node locked in version 8.2 or later. Without them, it's a boat anchor. You will still be able to see disks, manage raid, networking etc. If you have an existing relationship with NetApp, your local sales staff may be able to provide you short term demo licenses to just try it out.

What did the output of step 15 show? Especially disk show -a, and the output of "sysconfig"?

[Jelle]

Then I will see if I can find any license reseller, I'm sure I can find one in Denmark, thank you!

Here is the output of disk show and sysconfig:

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

If I shut down the disk shelf I get exactly the same outputs.

I can only find cabling guides for Metrocluster for FAS6210. How should I cable it? Using the bridge or using the SAS card in the controller? I've tried both and the only thing that produce an error is using the bridge, with the cannot find connection type error. There are no link LEDs blinking or lighting with SAS.

[Jelle]

I will have to see if I can find a license reseller here in Denmark if I can get the system to find the drives.

Here is the output of show disk and sysconfig:

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

If I turn off the disk shelf I get exactly the same output.

How do I cable this thing?

Using the bridge I still get a spam of connection type errors

Using SAS no LEDs light up at all

[Jelle]

Here is the output of disk show and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

I get the same output with the disk shelf turned off.

 

How do I actually cable this thing?

 

Using the bridge I just get the connection type error spam

 

Using SAS no LEDs light up


EDIT:

Here is an output from when it just finished booting:


Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...


0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.


So, how do I get rid of that connection type error spam when using the FC Bridge?

[Jelle]

So, I got it to find a disk shelf!

I used the FC bridge. I used a0 FC from the controller to port 2 on the FC bridge and SAS port 1 on the bridge to the shelf.

I can now see the shelf and all the drives!

I ran the rest of the commands in your list and the system started up fine and I initialized a new system.

Now I just want to ask, can I format the drives? I can see sanitize needs a license which this obviously doesn't have.

As far as I can google, I see that people say you have to wipe the configuration to wipe the drives. Is there a way to low level format them? This did not happen for me, or at least it took way less time than expected (24x 300GB 15K drives). I expected it to at least take an hour but I didn't even get to see it doing a format.

Can I run a command, or do I need to create a new storage volume using the vol command?

[Jelle]

Here is the output of disk show and sysconfig:

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

I get the same output with the disk shelf turned off.

How do I actually cable this thing?

Using the bridge I just get the connection type error spam

Using SAS no LEDs light up

EDIT:

Here is an output from when it just finished booting:

Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...

0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.

So, how do I get rid of that connection type error spam when using the FC Bridge?

[Jelle]

Here is the output of disk show and sysconfig:

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

I get the same output with the disk shelf turned off.

How do I actually cable this thing?

Using the bridge I just get the connection type error spam

Using SAS no LEDs light up

EDIT:

Here is an output from when it just finished booting:

Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...

0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.

So, how do I get rid of that connection type error spam when using the FC Bridge?

[Jelle]

Here is the output of disk show and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 😎
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

I get the same output with the disk shelf turned off.

 

How do I actually cable this thing?

 

Using the bridge I just get the connection type error spam

 

Using SAS no LEDs light up


EDIT:

Here is an output from when it just finished booting:


Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...


0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.


So, how do I get rid of that connection type error spam when using the FC Bridge?

[aborzenkov]

You confused SAS HBA and NVRAM. Your filer does not have SAS (which is expected for metrocluster configuration). So your only option is shelf connection via FC bridge. If you are going to actually use those filers, you better interconnect NVRAM as well to have HA. If not using FC-VI, cables are the same as for SAS shelves.

What is the reason to sanitize disks? It is not needed if you want to reuse them.

[Jelle]

First of all sorry for all the posts.

Whenever I made a post it would disappear but only after 10 minutes. So I could see my response, I could refresh pages (Even clearning cache) and the post would still be there, but 10 minutes later, gone.

How come the filer has SAS then? What is the purpose?

I would like to see if any of the drives I got is in bad condition. Check S.M.A.R.T or run a low level format just to make sure all the drives I received are in good condition and they won't fail after two days. Is there a function to do that?

EDIT:

I found disk maint command which seems to test the disks. I have tried to start them all for at disk test but it seems like not all can be run at the same time.

It seems like the system is trying to protect it's data, copying over data from disk 1 to another to test disk 1 so I have to wait for that.

Is there a way to let it not? I'm guessing deleting the storage pool (pool1) might do it, but how do I delete these?

Where do I find the basic commands to create and delete pools, change raid level etc?

I have tried storage pool delete but the command is not recognized. pool is not a valid subcommand for storage according to my system.

May seem trivial, but how do I perform these basic tasks?

This is the documentation I have been using:

https://docs.netapp.com/ontap-9/index.jsp?topic=%2Fcom.netapp.doc.dot-cm-cmpr-930%2FTOC__storage__pool.html

I also found that there might be a program that can connect to my controller to manage it using a GUI. Is that supported on my system? Would be much easier to use a GUI than looking for the commands.

[AlexDawson]

• I definitely received notification for all your responses.. Please just post it once and followup if you don't hear anything back
• Your system doesn't have SAS - it has a high availability interconnect that uses QSFP connection.
• You are after an X2065 SAS card - on the unsupported second hand market they are pretty cheap.
• For ONTAP 8.2, there is a java+flash based app for Windows and Linux (and unofficially Mac) called OnCommand System Manager, but it is for day to day use, not setup, which is where you are right now.
• For ONTAP 8.3 and later, there is an "on-box" HTML interface
• The documentation you are referring to is for a much later version of ONTAP with a different command structure - ONTAP 9 (Clustered ONTAP). You want 8.2 (7-Mode) documentation

[Jelle]

Thank you for your response!

Your assistance is greatly appreciated. I have found the right documentation and found how to create and destroy pools and aggregates.

I have marked your step by step reply as the answer as it was actually what did the trick.

Again thank you for your comprehensive assistance!

[AlexDawson]

You are most welcome - have fun!