FAS and V-Series Storage Systems Discussions

FAS6210 no drives found after cabling

Hello!

 

I recently got a FAS6210 controller (Single controller) with various disk shelves.

 

I am trying to connect just one shelf, but when the system has booted it tells me that no drives has been found and system will reboot.

 

I have been looking at cabling guides but none actually describe a single chassis with a single controller in it.

 

This is a lot of 6 3.5" shelves and 2 FAS6210 chassis both with just one controller. I got a bunch of FC to SAS converters with the lot as well.

 

As far as I can see I need to use a converter from 8G fibre to 6G SAS and use 0a FC port and route the SAS cable from the converter into the square of the disk shelf.

 

I have also tried to take a SAS cable from the controller to the bottom IO module on the disk shelf, it shows no link.

 

Whenever the connection type error pops up I can see the link LED flash both in the converter and on the controller.

 

I have attached various pictures to help show what I have done.

 

Any help would be greatly appreciated!

17 REPLIES

Re: FAS6210 no drives found after cabling

It sounds like you got metrocluster. I strongly recommend you to arrange for professional service from NetApp or partner. Setting up metrocluster needs some experience and far exceeds forum format.

 

Re: FAS6210 no drives found after cabling

Thank you for your answer aborzenkov!

 

I can change the setup to suit any easy setup as I have a second controller and various drive shelves, but I am not sure how to actually cable it as the diagrams seems quite complicated.

 

I am very familiar with IBM and HP systems, this is my first try on NetApp.

 

If I can change anything to make it easier for me to setup I would like to know.

 

Maybe just adding an additional shelf can help?

 

EDIT:

OK, I have spend some time researching what MetroCluster actually is, and it seems like the FAS6210 I have can't be configured any other way.

 

I don't care about data, preferably I could wipe the whole setup to make a new one. Is there a way of doing that without having to set up a full MetroCluster and just make one controller see one disk shelf?

 

If not I found this: https://library.netapp.com/ecm/ecm_download_file/ECMM1280255

Which I think can guide me through setting up the whole thing. I believe configuration should still be active in the system with this kind of setup.

 

Just weird I got 14 FC bridges with 2 chassis and 6 disk shelves, I can't see what I need that many for.

Re: FAS6210 no drives found after cabling

I agree with the other poster - it's probably a former metrocluster node. 

 

For an UNSUPPORTED process to turn it back into a standalone mode:

 

  1. - Shut down system
  2. - Remove FCVI card from slot 6
  3. - Ensure NVRAM8 card (large battery pack) is in slot 2
  4. - Connect serial cable
  5. - Power on system
  6. - Immediately after RAM test, press control-C and you should be at a LOADER A> prompt
  7. - type: set-defaults <enter> bye
  8. - System reboots.
  9. - Press control-C again "Loading Data ONTAP" - this will bring up a boot menu
  10. - Choose option 5 - Maintenance mode boot
  11. - In maintenance mode, run "ha-config show" - and it should show "mcc". Run "ha-config modify" and set to "non-ha"
  12. - Halt the system
  13. - Cable SAS shelves directly to controller
  14. - Boot into diagnostics again
  15. - Run "disk show" and then "disk removeowner", then "disk assign"
  16. - Reboot from maintenance mode, load boot menu again, choose option 4 - wipe config
  17. - Reboot again, disks will format in parallel (8hrs/3TB), shows lots of dots
  18. - At the end, system will go into setup mode

 

.. but once you get here, you'll need licenses, which are node-locked, and non-transferrable. So you'll be able to play with aggregate creation, volume creation, network port config, but no protocols will work.

Re: FAS6210 no drives found after cabling

Hello Alex!

 

Thank you for your post, it seems like this should be a solution.

 

Sorry for late reply, I have been lying sick like most people these days.

 

But what about the licenses? What licenses would I need? Is the system going to be unusable if I follow your steps?

 

I would just like to be able to create a storage pool and initialize/format the drives. They are all 300GB 15K so it shouldn't take too long.

 

Thanks for all your help!

 

EDIT:

 

OK so I tried your steps. ha-config show did show non-ha and not mcc but I ran it anyway.

 

I tried cabling the disk shelf via SAS to the controller, this results in no disks shown with disk show.

 

I also tried using fibre channel and the bridge, this results again in the connection type error being spammed until I remove the cable.

 

What do I do from here?

Re: FAS6210 no drives found after cabling

Our systems require licenses to enable any storage protocol - and they are non-transferrable, and node locked in version 8.2 or later. Without them, it's a boat anchor. You will still be able to see disks, manage raid, networking etc. If you have an existing relationship with NetApp, your local sales staff may be able to provide you short term demo licenses to just try it out.

 

What did the output of step 15 show? Especially disk show -a, and the output of "sysconfig"?

Re: FAS6210 no drives found after cabling

Then I will see if I can find any license reseller, I'm sure I can find one in Denmark, thank you!

 

Here is the output of disk show and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 8)
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

If I shut down the disk shelf I get exactly the same outputs.

 

I can only find cabling guides for Metrocluster for FAS6210. How should I cable it? Using the bridge or using the SAS card in the controller? I've tried both and the only thing that produce an error is using the bridge, with the cannot find connection type error. There are no link LEDs blinking or lighting with SAS.

Re: FAS6210 no drives found after cabling

I will have to see if I can find a license reseller here in Denmark if I can get the system to find the drives.

 

Here is the output of show disk and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 8)
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

If I turn off the disk shelf I get exactly the same output.

 

How do I cable this thing?

 

Using the bridge I still get a spam of connection type errors

 

Using SAS no LEDs light up at all

Re: FAS6210 no drives found after cabling

Here is the output of disk show and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 8)
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

I get the same output with the disk shelf turned off.

 

How do I actually cable this thing?

 

Using the bridge I just get the connection type error spam

 

Using SAS no LEDs light up

 

EDIT:

Here is an output from when it just finished booting:

 

Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...

 

0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.

 

So, how do I get rid of that connection type error spam when using the FC Bridge?

Re: FAS6210 no drives found after cabling

Here is the output of disk show and sysconfig:

 

*> disk show
Local System ID: 1873760935

disk show: No disks match option show.
*> disk show -a
Local System ID: 1873760935

disk show: No disks match option -a.
*> sysconfig
        NetApp Release 8.2.3P6 7-Mode: Tue Sep  1 08:58:43 PDT 2015
        System ID: 1873760935 ()
        System Serial Number: 700000545537 ()
        System Rev: A2
        System Storage Configuration: Unknown
        System ACP Connectivity: NA
        Backplane Part Number: 110-00147
        Backplane Rev: A2
        Backplane Serial Number: 8000293413
        slot 0: System Board
                Model Name:         FAS6210
                Processors:         8
                Processor type:     Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
                Memory Size:        24576 MB
                Memory Attributes:  Node Interleaving
                                    Hoisting
                                    Rank Interleaving
                                    Chipkill ECC
                Controller:         A
        Service Processor           Status: Unknown
                                      IPMI: unknown
                                       PKT: unknown
        slot 0: Internal 10/100 Ethernet Controller G20
                e0M MAC Address:    00:a0:98:14:fa:35 (auto-unknown-down)
                e0P MAC Address:    00:a0:98:14:fa:34 (auto-100tx-fd-up)
        slot 0: Dual 10/100/1000 Ethernet Controller G20
                e0a MAC Address:    00:a0:98:14:fa:33 (auto-unknown-down)
                e0b MAC Address:    00:a0:98:14:fa:32 (auto-unknown-down)
        slot 0: 10 Gigabit Ethernet Controller IX1-SFP+
                e0c MAC Address:    00:a0:98:14:ed:17 (auto-unknown-down)
                e0d MAC Address:    00:a0:98:14:ed:16 (auto-unknown-down)
                e0e MAC Address:    00:a0:98:14:ed:19 (auto-unknown-down)
                e0f MAC Address:    00:a0:98:14:ed:18 (auto-unknown-down)
        slot 0: Intel USB EHCI Adapter u0a (0xdfb00000)
                boot0   Micron Technology 0x655, class 0/0, rev 2.00/11.00, addr 2 1936MB 512B/sect (4DF0022700046991)
        slot 0: FC Host Adapter 0a
        slot 0: FC Host Adapter 0b
        slot 0: FC Host Adapter 0c
        slot 0: FC Host Adapter 0d
        slot 1: FC Host Adapter 1a
        slot 1: FC Host Adapter 1b
        slot 1: FC Host Adapter 1c
        slot 1: FC Host Adapter 1d
        slot 2: IB Host Adapter i2 (NVRAM8 ConnectX MT26418 rev. B0)

        Interconnect Port 1:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96e9
        Interconnect Port 2:
                Default GID:        fe80:0000:0000:0000:00a0:9800:0000:96ea
        slot 2: NVRAM (NVRAM 8)
                Revision:           A0
                Serial Number:      8000191110
                DIMM Size:          4096 MB
                Running Firmware:   1.0.9
        slot 3: Flash Cache (1.0 TB)
                         State:     Enabled
        slot 4: Quad Gigabit Ethernet Controller 82580
                e4a MAC Address:    00:1b:21:d2:eb:74 (auto-unknown-down)
                e4b MAC Address:    00:1b:21:d2:eb:75 (auto-unknown-down)
                e4c MAC Address:    00:1b:21:d2:eb:76 (auto-unknown-down)
                e4d MAC Address:    00:1b:21:d2:eb:77 (auto-unknown-down)

 

I get the same output with the disk shelf turned off.

 

How do I actually cable this thing?

 

Using the bridge I just get the connection type error spam

 

Using SAS no LEDs light up

 

EDIT:

Here is an output from when it just finished booting:

 

Storage Adapters found:
8 Fibre Channel Storage Adapters found!
0 SAS Adapters found!
0 Parallel SCSI Storage Adapters found!
0 ATA Adapters found!

Target Adapters found:
0 Fibre Channel Target Adapters found!
1 iSCSI Target Adapters found!
1 Unknown Target Adapters found!
HA Config: Chassis = non-ha  Controller = non-ha
Mar 07 09:20:15 [localhost:dcs.framework.enabled:info]: The DCS framework is enabled on this node.

Check that disks have been assigned ownership to this system (ID 1873760935) using the 'disk show' and 'disk assign'
commands from maintenance mode.

WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 2m0s
System rebooting...

 

0 SAS adapters found? There is one SAS adapter installed, but it could have failed? This should at least tell me why using SAS cabling doesn't work.

 

So, how do I get rid of that connection type error spam when using the FC Bridge?

Forums