Data ONTAP Discussions

Interconnect Port FAS8200 Won't Come Online

Hello All, 

 

Quick question. I have a FAS8200 series storage array that is in the process of being setup without professional services. I have configured ports e0a and e0b on both controlletrs and they are up, as you can see below.

 

Now when I connect the 40Gbe breakoput cable to my Cisco switch, I get no activity and only an orange light on the switch. 

 

The ports on the array are green but no activity. Is there some trick to getting the interconnect ports to show some activity or is there something simple I'm missing?

 

Keep in my I have not ran the cluster wizards etup yet, so of coure no LIF has been configured.

 

All of the ports aon the interconnect are configured the exact same (as they are for our working cluster) and there is no difference.

 

Any thoughts/suggestions etc????

 

::> network port show

 

Node: localhost

                                                  Speed(Mbps) Health

Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status

--------- ------------ ---------------- ---- ---- ----------- --------

e0M       Default      -                up   1500  auto/1000  -

e0a       Cluster      -                up   9000  auto/10000 -

e0b       Cluster      -                up   9000  auto/10000 -

e0c       Default      -                up   1500  1000/1000  -

e0d       Default      -                down 1500  1000/-     -

e0e       Default      -                down 1500  1000/-     -

e0f       Default      -                down 1500  auto/-     -

e1a       Default      -                down 1500  1000/-     -

e1e       Default      -                down 1500  1000/-     -

e2a       Default      -                down 1500  auto/-     -

e2b       Default      -                down 1500  auto/-     -

11 entries were displayed.

 

::>

::>

::>

::>

::> network port show

 

Node: localhost

                                                  Speed(Mbps) Health

Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status

--------- ------------ ---------------- ---- ---- ----------- --------

e0M       Default      -                up   1500  auto/1000  -

e0a       Cluster      -                up   9000  auto/10000 -

e0b       Cluster      -                up   9000  auto/10000 -

e0c       Default      -                up   1500  1000/1000  -

e0d       Default      -                down 1500  1000/-     -

e0e       Default      -                down 1500  auto/-     -

e0f       Default      -                down 1500  auto/-     -

e1a       Default      -                down 1500  1000/-     -

e1e       Default      -                down 1500  1000/-     -

e2a       Default      -                down 1500  1000/-     -

e2b       Default      -                down 1500  auto/-     -

11 entries were displayed.

28 REPLIES 28

Re: Interconnect Port FAS8200 Won't Come Online

You need to boot in to maint mode and convert the port : 

https://docs.netapp.com/ontap-9/index.jsp?topic=%2Fcom.netapp.doc.dot-cm-nmg%2FGUID-C9B047C2-1537-4A66-9677-342D237AD450.html  

 

each 40G port will become 4x10G ports and you'll see the following in ONTAP:  e1a e1b e1c e1d  etc..

Re: Interconnect Port FAS8200 Won't Come Online

I'm not sure how this is going to help based upon my previous statement that I'm using ports e0a & e0b. 

 

The ports are already set to 10G. 

 

Also, the change you mentioned I already ran on ports e0a & e0b before I even made this post. So what other ports are you saying need to be changed to 10G and why would that matter, if they are not the ports I'm using for the interconnect?

Re: Interconnect Port FAS8200 Won't Come Online

Just to be more specific, since th cluster wizard has not been ran yet, I'm cxonnecting to the controllers by way of the serial (RJ-45) console port.

 

So with that connection I assume that is essentially maintenance mode already. So I ran the command below to make sure the ports were at 10G, although they already were just as you see them now.

 

network port modify -node localhost -port e0b -autonegotiate-admin true -duplex-admin auto -speed-admin auto

Re: Interconnect Port FAS8200 Won't Come Online

you asked "Now when I connect the 40Gbe breakoput cable to my Cisco switch, I get no activity and only an orange light on the switch. "   

It's because they need to be converted to 10G ports before you can use the breakout cable.  

 

"So with that connection I assume that is essentially maintenance mode already. " Nope,  there is a boot option 5 in the boot menu that is Maint Mode.   

 

e0a/b are the default cluster ports for this model.   If you run the setup wizard (which you should do)  it'll auto gen/config what's needed to create the cluster network from those ports.   

Re: Interconnect Port FAS8200 Won't Come Online

Awww, I think I got what you mean now. You want me to actually chane the ports on the Cisco switch to 10G.

 

Well why didn't you just say that LOL 

 

Just kidding. 

 

Let me change those now on the Cisco switch.

Re: Interconnect Port FAS8200 Won't Come Online

Nothing on the switch side...   If you want to use the Netapp 40G ports that on your system are in slot 1 and 2,  e1a / e1e  and e1a /  e1e with the 40G breakout cable (breaks in to 4x10G LC LC)  you need to convert the port via maint mode.   

 

 

Re: Interconnect Port FAS8200 Won't Come Online

That's what I have been mentioning. I'm NOT using the slots cards. I have the breakout cable 40G connection to the Cisco Nexus 3k interconnect.

 

The 4-breakout 10G cables are connected directly to e0a & e0b on the controllers. 

 

So are you saying that is the wrong setup? Should I be using the exx series slots? I'm not using those, I'm using e0a & e0b.

 

 

Re: Interconnect Port FAS8200 Won't Come Online

Sorry,  that wasn't how I read it.   It looked like e0a/e0b was up and you where trying to use the 40G ports on the netapp with breakout cables.   

 

So youre using a Nexus 3232 as a cluster switch, and you're trying to connect e0a/b to it from each controller? 

Re: Interconnect Port FAS8200 Won't Come Online

Correct that is what I'm trying to do.

 

1 QSFP going to the interconnect switch.

4 Breakout cables on the other end going to e0a/b on both controllers.

Forums