Interconnect Port FAS8200 Won't Come Online

[General]

Hello All, 

Quick question. I have a FAS8200 series storage array that is in the process of being setup without professional services. I have configured ports e0a and e0b on both controlletrs and they are up, as you can see below.

Now when I connect the 40Gbe breakoput cable to my Cisco switch, I get no activity and only an orange light on the switch. 

The ports on the array are green but no activity. Is there some trick to getting the interconnect ports to show some activity or is there something simple I'm missing?

Keep in my I have not ran the cluster wizards etup yet, so of coure no LIF has been configured.

All of the ports aon the interconnect are configured the exact same (as they are for our working cluster) and there is no difference.

Any thoughts/suggestions etc????

::> network port show

Node: localhost

                                                  Speed(Mbps) Health

Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status

--------- ------------ ---------------- ---- ---- ----------- --------

e0M       Default      -                up   1500  auto/1000  -

e0a       Cluster      -                up   9000  auto/10000 -

e0b       Cluster      -                up   9000  auto/10000 -

e0c       Default      -                up   1500  1000/1000  -

e0d       Default      -                down 1500  1000/-     -

e0e       Default      -                down 1500  1000/-     -

e0f       Default      -                down 1500  auto/-     -

e1a       Default      -                down 1500  1000/-     -

e1e       Default      -                down 1500  1000/-     -

e2a       Default      -                down 1500  auto/-     -

e2b       Default      -                down 1500  auto/-     -

11 entries were displayed.

::>

::>

::>

::>

::> network port show

Node: localhost

                                                  Speed(Mbps) Health

Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status

--------- ------------ ---------------- ---- ---- ----------- --------

e0M       Default      -                up   1500  auto/1000  -

e0a       Cluster      -                up   9000  auto/10000 -

e0b       Cluster      -                up   9000  auto/10000 -

e0c       Default      -                up   1500  1000/1000  -

e0d       Default      -                down 1500  1000/-     -

e0e       Default      -                down 1500  auto/-     -

e0f       Default      -                down 1500  auto/-     -

e1a       Default      -                down 1500  1000/-     -

e1e       Default      -                down 1500  1000/-     -

e2a       Default      -                down 1500  1000/-     -

e2b       Default      -                down 1500  auto/-     -

11 entries were displayed.

[SpindleNinja]

Join will join to an existing.  Is it prompting for (been a while since I did a pre 9.3 setup.  is it asking for "and ip address of the other cluster"  or showing the remote cluster name?  

If it fails, it will either just hard fail (generally says something like "can't find the other cluster")   or end up in some weird limbo.       

9.2 you can also use the gui to expand the cluster, (though i've not ever done it)

   https://www.youtube.com/watch?v=w4-3bFtF2Us

Here's some additional reading on the cluster expansion:

https://docs.netapp.com/ontap-9/index.jsp?topic=%2Fcom.netapp.doc.exp-expand%2Fhome.html&cp=2_0. 

[SpindleNinja]

Found some additional info while reading though some other docs,  "FAS8200 platforms require 2x10GbE cluster interconnections. "      Meaning that the one 40G port (per switch) is connected to two ports on the 8200.  

e0a + another port.  

e0b + another port.  

on each controller. 

Are all the 10G ports on the swith used?

Might be worth opening a case though and see what they say.   

[General]

What you described is my exact setup. : )

So like I was mentionging along with yourself, I'm surpirsed it's not working as well.

[SpindleNinja]

if you have a 40G breakout coming out of each switch,  and cables plugged into e0a and e0b.  There are still two additional ends on each breakout that aren't connected anywhere correct?  or are they?

Are all the 10G ports on the swith used?

When running Cluster setup and then join.   Is it prompting for "and ip address of the other cluster"  or showing the remote cluster name?  

Anything in the error logs? 

But i'd open a support case at this poing. 

[General]

Too your question:

"if you have a 40G breakout coming out of each switch,  and cables plugged into e0a and e0b.  There are still two additional ends on each breakout that aren't connected anywhere correct?  or are they?"

No. Each 40G connector on the opposite end has 2 standard SFP+ connectors and they are both plugged into port e0a on both controllers for one cable.

The other 40G connector also has 2 standard SFP+ connections on the opposite end and they are connected to e0b on both controllers.

[SpindleNinja]

what's the part# of that cable? 

I don't see a single cable on HWU that's QSFP to 2xSFP+   they are QSFP to 4xSFP+

[General]

Let me find it and I will let you know.

[SpindleNinja]

and during the wizard it prompts saying something like..  

I'm going to use the following ports 

e0a 169.x.x.x 

e0b 169.x.x.x

And shortly later prompts to either enter the IP of the cluster you're joining or shows the name.