Hi!
We try to set up a FAS3250 cluster (7mode).
- System is two chassis configuration.
- Both filers have cluster licenses
- Every filer has partner-sysid (printenv partner-sysid)
- We use ports c0a and c0b for connection between filers (c0a -> c0a and c0b -> c0b)
- Each filer can see others filer disks (sysconfig-r output)
- cluster is enabled
The problem is that we have interconnect error. Cables are connected and there is no connection, we also try other cables and there is still no connection between filers.
Here are errors:
netappDEMO01*> cf status
netappDEMO02 is up, takeover disabled because of reason (interconnect error)
netappDEMO01 has disabled takeover by netappDEMO02 (interconnect error)
RDMA Interconnect is down (Link 0 down, Link 1 down).
netappDEMO01*>
netappDEMO01*> cf monitor
current time: 22Feb2013 10:06:25
UP 20:26:04, partner 'netappDEMO02', cluster monitor enabled
RDMA Interconnect is down (Link 0 down, Link 1 down), takeover capability off-line (interconnect error)
takeover by partner off-line (interconnect error)
partner update TAKEOVER_DISABLED (22Feb2013 10:06:22)
netappDEMO01*> ic status
Link 0: down
Link 1: down
IC RDMA connection : down
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
Device Type: CT-FE-3
Version Number: T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04
Serial Number: jb04050693
c0a MAC Address: 00:a0:98:38:02:fe (auto-unknown-enabling)
c0b MAC Address: 00:a0:98:38:02:ff (auto-unknown-enabling)
netappDEMO01*> ic config show
Interconnect Type: iWARP
Local System ID: 20145XXXXXX
Partner System ID: 20145XXXXX
c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE
inet 192.168.1.126 netmask 0xffffff00 broadcast 192.168.1.255
ether 00:a0:98:38Fri Feb:03:fe (auto-unknown-enabling) flowcontrol full
c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE
inet 192.168.2.177 netmask 0xffffff00 broadcast 192.168.2.255
ether 00:a0:98:38:03:ff (auto-unknown-enabling) flowcontro 22 10:l full
In syslogs we get this errror: Failover is licensed but takeover of partner is disabled due to reason : interconnect error.
The question is how to enable or repair this connection between two filers? They are aware of each other but there is no link between them.
Does anybody know what is the problem here?
Thank you!
With regards,
Klemen
