ONTAP Discussions

FAS3250 interconnect error

klemen_bregar
15,712 Views

Hi!

We try to set up a FAS3250 cluster (7mode).

- System is two chassis configuration.

- Both filers have cluster licenses

- Every filer has partner-sysid (printenv partner-sysid)

- We use ports c0a and c0b for connection between filers (c0a -> c0a and c0b -> c0b)

- Each filer can see others filer disks (sysconfig-r output)

- cluster is enabled

The problem is that we have interconnect error. Cables are connected and there is no connection, we also try other cables and there is still no connection between filers.

Here are errors:

netappDEMO01*> cf status

netappDEMO02 is up, takeover disabled because of reason (interconnect error)

netappDEMO01 has disabled takeover by netappDEMO02 (interconnect error)

RDMA Interconnect is down (Link 0 down, Link 1 down).

netappDEMO01*>

netappDEMO01*> cf monitor

  current time: 22Feb2013 10:06:25

  UP 20:26:04, partner 'netappDEMO02', cluster monitor enabled

  RDMA Interconnect is down (Link 0 down, Link 1 down), takeover capability off-line (interconnect error)

  takeover by partner off-line (interconnect error)

  partner update TAKEOVER_DISABLED (22Feb2013 10:06:22)

        netappDEMO01*> ic status

        Link 0: down

        Link 1: down

        IC RDMA connection : down


                slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                Device Type:        CT-FE-3

                Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                Serial Number:      jb04050693

                c0a MAC Address:    00:a0:98:38:02:fe (auto-unknown-enabling)

                c0b MAC Address:    00:a0:98:38:02:ff (auto-unknown-enabling)

netappDEMO01*> ic config show

Interconnect Type: iWARP

  Local System ID: 20145XXXXXX

Partner System ID: 20145XXXXX

c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.1.126 netmask 0xffffff00 broadcast 192.168.1.255

        ether 00:a0:98:38Fri Feb:03:fe (auto-unknown-enabling) flowcontrol full

c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.2.177 netmask 0xffffff00 broadcast 192.168.2.255

        ether 00:a0:98:38:03:ff (auto-unknown-enabling) flowcontro 22 10:l full

In syslogs we get this errror: Failover is licensed but takeover of partner is disabled due to reason : interconnect error.

The question is how to enable or repair this connection between two filers? They are aware of each other but there is no link between them.

Does anybody know what is the problem here?

Thank you!

With regards,

Klemen

18 REPLIES 18

aborzenkov
15,558 Views

Is it new installation or it worked before?

klemen_bregar
15,558 Views

New system. It was shipped as clustered ontap.

Also, we have done "set-defaults".

Klemen

klemen_bregar
15,558 Views

i have also try this, result is the same...

netappDEMO01*> ic link off 0

Fri FebFri Feb 22 10 22 10::37:50 CET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be o37:50 Cn dedicated management subnets.

ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.1netappDEMO01*> 68.8.200' configured Fri Feb 22 10:37:50 Con dataET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

port e0a. Management IP addresses must be on dedicated management subnets.

Fri Feb 22 10:37:50 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

netappDEMO01*>

netappDEMO01*> ic link off 1

netappDEMO01*> Fri FebFri Feb 22 10:37:56 CET [neta 22 10:ppDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

37:56 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

netappDEMO01*> ic link on 1

netappDEMO01*> Fri FebFri Feb 22 10:38:31 CET [ne 22 10:tappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated ma38:31 Cnagement subnets.

ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated management subnets.

ic link on 0

netappDEMO01*> ic link on 0

interface 0 is already up

netappDEMO01*>

netappDEMO01*>

netappDEMO01*> Fri FebFri Feb 22 10:38:39 CET [netappDEMO01:netif.linkInfo:info 22 10:]: Ethernet c0b: Link configured down.

38:39 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0b: Link configured down.

netappDEMO01*> Fri FebFri Feb 22 10:38:42 CET [netapp 22 10:DEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

38:42 CET [netappDEMO01:netif.linkInfo:info]: Ethernet c0a: Link configured down.

netappDEMO01*>

netappDEMO01*> ic status

        Link 0: down

        Link 1: down

        IC RDMA connection : down

netappDEMO01*>

martin_fisher
15,558 Views

Hi - First thing i would check is the IP addresses used for you interfaces. The console is display these error messages:

netappDEMO01*> Fri FebFri Feb 22 10:38:31 CET [ne 22 10:tappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated ma38:31 Cnagement subnets.

ET [netappDEMO01:net.if.mgmt.sameSubnet:warning]: ifconfig: IP address '192.168.8.201' configured on dedicated management port 'e0M' is on the same subnet as IP address '192.168.8.200' configured on data port e0a. Management IP addresses must be on dedicated management subnets.

ic link on 0

it appears as though you have IP Address set on the management interface (e0M) which is in the same subnet as one set physical interface e0a. This will cause problems as the appliance wont no where to route your IC traffic, or your IC traffic is routing out of your e0a interface!. The management nic's e0m, need there own subnet. ie 192.168.8.x and other interfaces or interface groups need a separate one, ie 192.168.9.x

aborzenkov
15,558 Views

Have you verified that correct ports are connected? No kidding, mistakes happen.

Have you verified you used the correct cables? How they are marked?

I would cf disable, removing CF license, reboot, verify systems came up as standalone and then re-enabling

klemen_bregar
15,558 Views

hi!

i have checked: c0a --> c0a and c0b --> c0b (still no lights)

i have done all as you said, result is the same:

netappDEMO01> cf status

netappDEMO02 is up, takeover disabled because of reason (interconnect error)

netappDEMO01 has disabled takeover by netappDEMO02 (interconnect error)

RDMA Interconnect is down (Link 0 down, Link 1 down).

netappDEMO01>

netappDEMO01> cf monitor

  current time: 22Feb2013 15:29:09

  UP 00:03:08, partner 'netappDEMO02', cluster monitor enabled

  RDMA Interconnect is down (Link 0 down, Link 1 down), takeover capability off-line (interconnect error)

  takeover by partner off-line (interconnect error)

  partner update TAKEOVER_DISABLED (22Feb2013 15:29:09)

netappDEMO01>

netappDEMO01> ic status

netappDEMO01*> ic status

        Link 0: down

        Link 1: down

        IC RDMA con

with regards,

Klemen

martin_fisher
15,558 Views

what is output of the ifconfig -a command if you can post it please?

klemen_bregar
15,558 Views

hi!

i have removed e0a port on both systems. The same problem.

output:

netappDEMO02> ifconfig -a

e0a: flags=0x2f0c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

        ether 00:a0:98:38:02:fc (auto-1000t-fd-up) flowcontrol full

e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

        ether 00:a0:98:38:02:fd (auto-unknown-down) flowcontrol full

e1a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:83:2c (auto-unknown-down) flowcontrol full

e1b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:83:2d (auto-unknown-down) flowcontrol full

e2a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:7b:3c (auto-unknown-down) flowcontrol full

e2b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:7b:3d (auto-unknown-down) flowcontrol full

c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.1.70 netmask 0xffffff00 broadcast 192.168.1.255

        ether 00:a0:98:38:02:fe (auto-unknown-enabling) flowcontrol full

c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.2.158 netmask 0xffffff00 broadcast 192.168.2.255

        ether 00:a0:98:38:02:ff (auto-unknown-enabling) flowcontrol full

e0M: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500

        inet 192.168.8.203 netmask 0xffffff00 broadcast 192.168.8.255 noddns

        partner inet 192.168.8.201 (not in use)

        ether 00:a0:98:38:03:00 (auto-100tx-fd-up) flowcontrol full

e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE

        inet 192.168.1.176 netmask 0xfffffc00 broadcast 192.168.3.255 noddns

        ether 00:a0:98:38:03:01 (auto-100tx-fd-up) flowcontrol full

lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160

        inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1

        ether 00:00:00:00:00:00 (RNIC Provider)

losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188

        inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1

netappDEMO02>

netappDEMO01*> ifconfig -a

e0a: flags=0x2f0c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

        ether 00:a0:98:38:03:fc (auto-1000t-fd-up) flowcontrol full

e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

        ether 00:a0:98:38:03:fd (auto-unknown-down) flowcontrol full

e1a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2e:37:08 (auto-unknown-down) flowcontrol full

e1b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2e:37:09 (auto-unknown-down) flowcontrol full

e2a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:82:f0 (auto-unknown-down) flowcontrol full

e2b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500

        ether 90:e2:ba:2f:82:f1 (auto-unknown-down) flowcontrol full

c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.1.230 netmask 0xffffff00 broadcast 192.168.1.255

        ether 00:a0:98:38:03:fe (auto-unknown-enabling) flowcontrol full

c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.2.9 netmask 0xffffff00 broadcast 192.168.2.255

        ether 00:a0:98:38:03:ff (auto-unknown-enabling) flowcontrol full

e0M: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500

        inet 192.168.8.201 netmask 0xffffff00 broadcast 192.168.8.255 noddns

        partner inet 192.168.8.203 (not in use)

        ether 00:a0:98:38:04:00 (auto-100tx-fd-up) flowcontrol full

e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE

        inet 192.168.1.167 netmask 0xfffffc00 broadcast 192.168.3.255 noddns

        ether 00:a0:98:38:04:01 (auto-100tx-fd-up) flowcontrol full

lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160

        inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1

        ether 00:00:00:00:00:00 (RNIC Provider)

losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188

        inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1

netappDEMO01*>

netappDEMO01*> ic config show

Interconnect Type: iWARP

  Local System ID: 2014xxxxxx

Partner System ID: 2014xxxxx

c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.1.230 netmask 0xffffff00 broadcast 192.168.1.255

        ether 00:a0:98:38:03:fe (auto-unknown-down) flowcontrol full

c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE

        inet 192.168.2.9 netmask 0xffffff00 broadcast 192.168.2.255

        ether 00:a0:98:38:03:ff (auto-unknown-down) flowcontrol full

netappDEMO01*>

Klemen

dlira
15,558 Views

You can send the output of the following command

sysconfig -a 0

klemen_bregar
10,704 Views

Hi!

Here is output:

netappDEMO02> sysconfig -a 0

        slot 0: System Board 2.3 GHz (System Board XVI B1)

                Model Name:         FAS3250

                Part Number:        111-01062

                Revision:           B1

                Serial Number:      xxxxxxxxx

                BIOS version:       5.2.0

                Loader version:     3.4

                Processors:         8

                Processor ID:       0x1067a

                Microcode Version:  0xa0b

                Processor type:     Intel(R) Xeon(R) CPU           L5410  @ 2.33GHz

                Memory Size:        20480 MB

                Memory Attributes:  Bank Interleaving

                                    Hoisting

                                    Rank Interleaving

                                    Chipkill ECC

                NVMEM Size:         2000 MB of Main Memory Used

                CMOS RAM Status:    OK

        Service Processor           Status: Online

                Firmware Version:   1.3.1

                Mgmt MAC Address:   00:A0:98:38:03:02

                Ethernet Link:      up, 100Mb, full duplex, auto-neg complete

                Using DHCP:         yes

        IPv4 configuration:

                IP Address:         192.168.8.111

                Netmask:            255.255.255.0

                Gateway:            192.168.8.1

        IPv6 configuration:         Disabled

        IOXM                        Status: present

                Power:              Good

                Agent version:      N/A

                Serial Number:      9409837074

                Part Number:        111-00647

                Version:            C0

        slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                Device Type:        CT-FE-3

                Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                Serial Number:      jb04050693

                c0a MAC Address:    00:a0:98:38:02:fe (auto-unknown-enabling)

                c0b MAC Address:    00:a0:98:38:02:ff (auto-unknown-enabling)

                        memory mapped I/O base 0xde801000, size 0x1000

                        memory mapped I/O base 0xde000000, size 0x800000

                        memory mapped I/O base 0xde800000, size 0x1000

        slot 0: Internal BGE 10/100 Ethernet Controller

                e0M MAC Address:    00:a0:98:38:03:00 (auto-100tx-fd-up)

                e0P MAC Address:    00:a0:98:38:03:01 (auto-100tx-fd-up)

                Device Type:        BCM5721

                        memory mapped I/O base 0xdfa00000, size 0x10000

                        memory mapped I/O base 0xdfb00000, size 0x10000

        slot 0: Dual 10/100/1000 Ethernet Controller G20

                e0a MAC Address:    00:a0:98:38:02:fc (auto-1000t-fd-up)

                e0b MAC Address:    00:a0:98:38:02:fd (auto-unknown-down)

                Device Type:        Rev 6

                        memory mapped I/O base 0x00000000df920000, size 0x20000

                        memory mapped I/O base 0x00000000df900000, size 0x20000

                        I/O base 0x0000000000003000, size 0x20

                        memory mapped I/O base 0x00000000df960000, size 0x20000

                        memory mapped I/O base 0x00000000df940000, size 0x20000

                        I/O base 0x0000000000003020, size 0x20

        slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)

                Firmware rev:       01.11.00.00

                Base WWN:           5:00a098:0012a5f:88

                Phy State:          [0] Enabled, 3.0 Gb/s

                                    [1] Enabled, 3.0 Gb/s

                                    [2] Enabled, 3.0 Gb/s

                                    [3] Enabled, 3.0 Gb/s

                QSFP Vendor:        Molex Inc.

                QSFP Part Number:   112-00178+A0

                QSFP Type:          Passive Copper 5m ID:00

                QSFP Serial Number: 223021420

                00.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYVYKVN)

                00.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWSN)

                00.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN5N)

                00.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTM0N)

                00.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTU7N)

                00.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTPVN)

                00.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU04N)

                00.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWYN)

                00.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU3WN)

                00.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTRYN)

                00.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4KN)

                00.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHDVN)

                00.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTHXN)

                00.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN7N)

                00.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTNYN)

                00.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4RN)

                00.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTJPN)

                00.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU03N)

                00.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHGDN)

                00.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPG9YN)

                00.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPLKBN)

                00.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYNKL2N)

                00.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYRBX1N)

                00.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPZ4KN)

                01.0 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900225)

                01.1 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900047)

                01.2 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900231)

                01.3 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900233)

                01.4 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900232)

                01.5 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900229)

                01.6 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J8357BHL)

                01.7 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83491VL)

                01.8 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83577WL)

                01.9 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83492UL)

                01.10: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82S8EYL)

                01.11: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82GUKHL)

                14.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60YVN)

                14.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXVN)

                14.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5KL5N)

                14.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXUN)

                14.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MKGN)

                14.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H1GN)

                14.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HY4N)

                14.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H50N)

                14.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6112N)

                14.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60J0N)

                14.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6A5PN)

                14.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60G2N)

                14.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MMMN)

                14.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MHAN)

                14.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5TSVN)

                14.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GYVN)

                14.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GXJN)

                14.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV607YN)

                14.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY17N)

                14.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY0SN)

                14.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV2D09N)

                14.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6093N)

                14.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HSSN)

                14.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60R7N)

                Shelf   0: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                Shelf   1: IOM3  Firmware rev. IOM3 A: 0151 IOM3 B: 0151

                Shelf  14: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

        slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)

                Firmware rev:       01.11.00.00

                Base WWN:           5:00a098:0012a5f:8c

                Phy State:          [4] Disabled

                                    [5] Disabled

                                    [6] Disabled

                                    [7] Disabled

                QSFP Vendor:        not available

                QSFP Part Number:   not available

                QSFP Type:          not available

                QSFP Serial Number: not available

                        memory mapped I/O base 0xdf830000, size 0x10000

                        memory mapped I/O base 0xdf820000, size 0x10000

                        memory mapped I/O base 0x00000000df810000, size 0x10000

                        memory mapped I/O base 0x00000000df800000, size 0x10000

        slot 0: FC Host Adapter 0c (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                Firmware rev:      5.4.100

                Host Loop Id:      0

                FC Node Name:      5:00a:098001:2a5f80

                FC Port Name:      5:00a:098001:2a5f80

                SFF Vendor:

                SFF Part Number:

                SFF Serial Number:

                SFF Capabilities:

                Link Data Rate:    N/A

                        I/O base 0x0000000000002000, size 0x100

                        memory mapped I/O base 0xdf700000, size 0x4000

        slot 0: FC Host Adapter 0d (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                Firmware rev:      5.4.100

                Host Loop Id:      0

                FC Node Name:      5:00a:098101:2a5f80

                FC Port Name:      5:00a:098101:2a5f80

                SFF Vendor:

                SFF Part Number:

                SFF Serial Number:

                SFF Capabilities:

                Link Data Rate:    N/A

                        I/O base 0x0000000000002400, size 0x100

                        memory mapped I/O base 0xdf704000, size 0x4000

        slot 0: Intel ICH USB EHCI Adapter u0a (0xdfc01400)

                boot0   Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (4BF0022700206173)

                        memory-mapped I/O base 0xdfc01400, size 0x400

netappDEMO02>

netappDEMO01*> sysconfig -a 0

        slot 0: System Board 2.3 GHz (System Board XVI B1)

                Model Name:         FAS3250

                Part Number:        111-01062

                Revision:           B1

                Serial Number:      xxxxxxxxxxx

                BIOS version:       5.2.0

                Loader version:     3.4

                Processors:         8

                Processor ID:       0x1067a

                Microcode Version:  0xa0b

                Processor type:     Intel(R) Xeon(R) CPU           L5410  @ 2.33GHz

                Memory Size:        20480 MB

                Memory Attributes:  Bank Interleaving

                                    Hoisting

                                    Rank Interleaving

                                    Chipkill ECC

                NVMEM Size:         2000 MB of Main Memory Used

                CMOS RAM Status:    OK

        Service Processor           Status: Online

                Firmware Version:   1.3.1

                Mgmt MAC Address:   00:A0:98:38:04:02

                Ethernet Link:      up, 100Mb, full duplex, auto-neg complete

                Using DHCP:         yes

        IPv4 configuration:

                IP Address:         192.168.8.113

                Netmask:            255.255.255.0

                Gateway:            192.168.8.1

        IPv6 configuration:         Disabled

        IOXM                        Status: present

                Power:              Good

                Agent version:      N/A

                Serial Number:      9409840928

                Part Number:        111-00647

                Version:            C0

        slot 0: Dual 10G Ethernet Controller T320E-SFP/KR

                Device Type:        CT-FE-3

                Version Number:     T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04

                Serial Number:      jb04050693

                c0a MAC Address:    00:a0:98:38:03:fe (auto-unknown-down)

                c0b MAC Address:    00:a0:98:38:03:ff (auto-unknown-down)

                        memory mapped I/O base 0xde801000, size 0x1000

                        memory mapped I/O base 0xde000000, size 0x800000

                        memory mapped I/O base 0xde800000, size 0x1000

        slot 0: Internal BGE 10/100 Ethernet Controller

                e0M MAC Address:    00:a0:98:38:04:00 (auto-100tx-fd-up)

                e0P MAC Address:    00:a0:98:38:04:01 (auto-100tx-fd-up)

                Device Type:        BCM5721

                        memory mapped I/O base 0xdfa00000, size 0x10000

                        memory mapped I/O base 0xdfb00000, size 0x10000

        slot 0: Dual 10/100/1000 Ethernet Controller G20

                e0a MAC Address:    00:a0:98:38:03:fc (auto-1000t-fd-up)

                e0b MAC Address:    00:a0:98:38:03:fd (auto-unknown-down)

                Device Type:        Rev 6

                        memory mapped I/O base 0x00000000df920000, size 0x20000

                        memory mapped I/O base 0x00000000df900000, size 0x20000

                        I/O base 0x0000000000003000, size 0x20

                        memory mapped I/O base 0x00000000df960000, size 0x20000

                        memory mapped I/O base 0x00000000df940000, size 0x20000

                        I/O base 0x0000000000003020, size 0x20

        slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)

                Firmware rev:       01.11.00.00

                Base WWN:           5:00a098:0012a61:88

                Phy State:          [0] Enabled, 3.0 Gb/s

                                    [1] Enabled, 3.0 Gb/s

                                    [2] Enabled, 3.0 Gb/s

                                    [3] Enabled, 3.0 Gb/s

                QSFP Vendor:        Molex Inc.

                QSFP Part Number:   112-00178+A0

                QSFP Type:          Passive Copper 5m ID:01

                QSFP Serial Number: 223021461

                00.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYVYKVN)

                00.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWSN)

                00.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN5N)

                00.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTM0N)

                00.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTU7N)

                00.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTPVN)

                00.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU04N)

                00.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTWYN)

                00.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU3WN)

                00.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTRYN)

                00.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4KN)

                00.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHDVN)

                00.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTHXN)

                00.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTN7N)

                00.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTNYN)

                00.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU4RN)

                00.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXTJPN)

                00.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYXU03N)

                00.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYYHGDN)

                00.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPG9YN)

                00.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPLKBN)

                00.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYNKL2N)

                00.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYRBX1N)

                00.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYPZ4KN)

                01.0 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900225)

                01.1 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900047)

                01.2 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900231)

                01.3 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900233)

                01.4 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900232)

                01.5 : NETAPP   X441_SS161100BSM NA01  95.1GB 520B/sect (S0SPNEAB900229)

                01.6 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J8357BHL)

                01.7 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83491VL)

                01.8 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83577WL)

                01.9 : NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J83492UL)

                01.10: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82S8EYL)

                01.11: NETAPP   X302_HJUPI01TSSM NA02 847.5GB 512B/sect (J82GUKHL)

                14.0 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60YVN)

                14.1 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXVN)

                14.2 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5KL5N)

                14.3 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HXUN)

                14.4 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MKGN)

                14.5 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H1GN)

                14.6 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HY4N)

                14.7 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6H50N)

                14.8 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6112N)

                14.9 : NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60J0N)

                14.10: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6A5PN)

                14.11: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60G2N)

                14.12: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MMMN)

                14.13: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6MHAN)

                14.14: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV5TSVN)

                14.15: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GYVN)

                14.16: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6GXJN)

                14.17: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV607YN)

                14.18: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY17N)

                14.19: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (LXYZY0SN)

                14.20: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV2D09N)

                14.21: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6093N)

                14.22: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV6HSSN)

                14.23: NETAPP   X412_HVIPC560A15 NA02 560.0GB 520B/sect (CZV60R7N)

                Shelf   0: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

                Shelf   1: IOM3  Firmware rev. IOM3 A: 0151 IOM3 B: 0151

                Shelf  14: IOM3  Firmware rev. IOM3 A: 0152 IOM3 B: 0152

        slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)

                Firmware rev:       01.11.00.00

                Base WWN:           5:00a098:0012a61:8c

                Phy State:          [4] Disabled

                                    [5] Disabled

                                    [6] Disabled

                                    [7] Disabled

                QSFP Vendor:        not available

                QSFP Part Number:   not available

                QSFP Type:          not available

                QSFP Serial Number: not available

                        memory mapped I/O base 0xdf830000, size 0x10000

                        memory mapped I/O base 0xdf820000, size 0x10000

                        memory mapped I/O base 0x00000000df810000, size 0x10000

                        memory mapped I/O base 0x00000000df800000, size 0x10000

        slot 0: FC Host Adapter 0c (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                Firmware rev:      5.4.100

                Host Loop Id:      0

                FC Node Name:      5:00a:098001:2a6180

                FC Port Name:      5:00a:098001:2a6180

                SFF Vendor:

                SFF Part Number:

                SFF Serial Number:

                SFF Capabilities:

                Link Data Rate:    N/A

                        I/O base 0x0000000000002000, size 0x100

                        memory mapped I/O base 0xdf700000, size 0x4000

        slot 0: FC Host Adapter 0d (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)

                Firmware rev:      5.4.100

                Host Loop Id:      0

                FC Node Name:      5:00a:098101:2a6180

                FC Port Name:      5:00a:098101:2a6180

                SFP Vendor:        AVAGO

                SFP Part Number:   AFBR-57R6APZ-NA1

                SFP Serial Number: B812320H06

                SFP Capabilities:  1, 2 or 4 Gbit

                Link Data Rate:    N/A

                        I/O base 0x0000000000002400, size 0x100

                        memory mapped I/O base 0xdf704000, size 0x4000

        slot 0: Intel ICH USB EHCI Adapter u0a (0xdfc01400)

                boot0   Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (4BF0022700206091)

                        memory-mapped I/O base 0xdfc01400, size 0x400

netappDEMO01*>

scottgelb
10,704 Views

Do you have a case open?  c0n ports not coming up sounds like a bad cable or port problem.

klemen_bregar
10,704 Views

hi!

i did not open a case, this is demo system. I have connect with netapp original cables, also try new ones.

I will find part number.

br,

Klemen

PHUONGPH2
10,704 Views

Dear all, i have FAS3210, i run: "cf status", it show "disabled", someone can tell me if i run "cf enabled" it required reboot or not the system. My FAS3210 already have cluster license.

Thanks.

aborzenkov
10,704 Views

If this is the very first time you enable cf after installation of license - yes, it requires reboot.

PHUONGPH2
10,704 Views

dear aborzenkov, after i add cluster license, i already reboot the system once. Now i run "cf enable", it need reboot the system again??? and yes, i never run "cf enable" before.

aborzenkov
9,217 Views

I stay corrected - I reviewed documentation and it says to reboot after adding license, not after “cf enable”.

PHUONGPH2
9,217 Views

thanks very much, so it not require reboot?? because my system its up and running, with data, and rebooting process it very complicated for me, i have to inform all team (app, database, exchange...), if its not need to reboot, it is very good news for me.

MYNETAPP_
9,217 Views

just had the same issue, resolved by a friend .

but this was for cluster mode, the below is how we solved it, maybye you can find something in it for you.

storage failover show -instance

1 node is non-ha mode

storage failover modify -node {nodename} -mode ha

reboot

Public