FAS 2552 HA interconnect: Connection for 'cfo_rv' failed.

Taek · ‎2016-09-12

After update software to ontap9, and restore config to default, I have this problem.

Before I can configure FAS2552 with Node Setup, configure IP and use Windows System Setup.

like this example

Spoiler

Welcome to node setup.

You can enter the following commands at any time:

"help" or "?" - if you want to have a question clarified,

"back" - if you want to change previously answered questions, and

"exit" or "quit" - if you want to quit the setup wizard.

Any changes you made before quitting will be saved.

To accept a default or omit a question, do not enter a value.

This system will send event messages and weekly reports to NetApp Technical

Support.

To disable this feature, enter "autosupport modify -support disable" within 24

hours.

Enabling AutoSupport can significantly speed problem determination and

resolution should a problem occur on your system.

For further information on AutoSupport, see:

http://support.netapp.com/autosupport/

Type yes to confirm and continue {yes}: yes

Enter the node management interface port [e0c]: e0M

Enter the node management interface IP address: 172.16.254.100

Enter the node management interface netmask: 255.255.255.0

Enter the node management interface default gateway: 172.16.254.1

A node management interface on port e0M with IP address 172.16.254.100 has been created.

This node has its management address assigned and is ready for cluster setup.

To complete cluster setup after all nodes are ready, download and run the System Setup utility from the NetApp Support Site and use it to discover the configured nodes.

For System Setup, this node's management address is: 172.16.254.100.

Alternatively, you can use the "cluster setup" command to configure the cluster.

Welcome to node setup. You can enter the following commands at any time: "help" or "?" - if you want to have a question clarified, "back" - if you want to change previously answered questions, and "exit" or "quit" - if you want to quit the setup wizard. Any changes you made before quitting will be saved. To accept a default or omit a question, do not enter a value. This system will send event messages and weekly reports to NetApp TechnicalSupport.To disable this feature, enter "autosupport modify -support disable" within 24hours.Enabling AutoSupport can significantly speed problem determination andresolution should a problem occur on your system.For further information on AutoSupport, see:http://support.netapp.com/autosupport/ Type yes to confirm and continue {yes}: yes Enter the node management interface port [e0c]: e0MEnter the node management interface IP address: 172.16.254.100Enter the node management interface netmask: 255.255.255.0Enter the node management interface default gateway: 172.16.254.1A node management interface on port e0M with IP address 172.16.254.100 has been created. This node has its management address assigned and is ready for cluster setup. To complete cluster setup after all nodes are ready, download and run the System Setup utility from the NetApp Support Site and use it to discover the configured nodes. For System Setup, this node's management address is: 172.16.254.100. Alternatively, you can use the "cluster setup" command to configure the cluster.

Now I cant use this method. Node offers "Welcome to the cluster setup wizard."

Boot log:

Spoiler

Boot Loader version 4.3
Copyright (C) 2000-2003 Broadcom Corporation.
Portions Copyright (C) 2002-2014 NetApp, Inc. All Rights Reserved.

CPU Type: Intel(R) Xeon(R) CPU C3528 @ 1.73GHz

Starting AUTOBOOT press Ctrl-C to abort...
Loading X86_64/freebsd/image1/kernel:0x200000/10341088 0xbdcae0/5815208 Entry at 0x80293660
Loading X86_64/freebsd/image1/platform.ko:0x1169000/2266392 0x1393518/350312 0x13e8d80/269520
Starting program at 0x80293660
NetApp Data ONTAP 9.0
Trying to mount root from msdosfs:/dev/da0s1 [ro]...
md0 attached to /X86_64/freebsd/image1/rootfs.img
Trying to mount root from ufs:/env/md0.uzip []...
mountroot: waiting for device /env/md0.uzip ...
Copyright (C) 1992-2016 NetApp.
All rights reserved.
*******************************
* *
* Press Ctrl-C for Boot Menu. *
* *
*******************************
Firewall rules loaded.
qla_init_hw: CRBinit running ok: 8c633f
NIC FW version in flash: 5.4.9
qla_init_hw: CRBinit running ok: 8c633f
NIC FW version bundled: 5.4.56
Ipspace "ACP" created
link speed 10Gps
Module Type 10GBase-LR
link speed 10Gps
Module Type 10GBase-LR
WAFL CPLEDGER is enabled. Checklist = 0x7ff841ff
Sep 12 09:00:37 [localhost:cf.nm.nicReset:notice]: HA interconnect: Initiating soft reset on card 0 due to rendezvous reset.
Sep 12 09:00:37 [localhost:cf.rv.notConnected:ALERT]: HA interconnect: Connection for 'cfo_rv' failed.
add host 127.0.10.1: gateway 127.0.20.1
Sep 12 09:00:40 [localhost:cf.fm.notkoverClusterDisable:error]: Failover monitor: takeover disabled (restart)
Sep 12 09:00:40 [localhost:cf.nm.nicReset:notice]: HA interconnect: Initiating soft reset on card 0 due to rendezvous reset.
boot_from_disk:last_booted_OS:9.0
Sep 12 09:00:40 [localhost:kern.syslog.msg:notice]: The system was down for 168 seconds
Sep 12 09:00:40 [localhost:cf.rv.notConnected:ALERT]: HA interconnect: Connection for 'cfo_rv' failed.
There are 14 spare disks; you may want to use the vol or aggr command
to create new volumes or aggregates or add disks to the existing aggregate.
Sep 12 09:00:41 [localhost:cf.fsm.takeoverOfPartnerDisabled:error]: Failover monitor: takeover of partner disabled (Controller Failover takeover disabled).
Sep 12 09:00:41 [localhost:kern.syslog.msg:notice]: domain xing mode: off, domain xing interrupt: false
Sep 12 09:00:41 [localhost:clam.invalid.config:error]: Local node (name=unknown, id=0) is in an invalid configuration for providing CLAM functionality.
CLAM cannot determine the identity of the HA partner.
Adding /mroot/etc/swapfile as additional swap
Sep 12 09:01:00 [localhost:monitor.globalStatus.critical:EMERGENCY]: Controller failover partner unknown. Controller failover not possible.

Welcome to the cluster setup wizard.

You can enter the following commands at any time:
"help" or "?" - if you want to have a question clarified,
"back" - if you want to change previously answered questions, and
"exit" or "quit" - if you want to quit the cluster setup wizard.
Any changes you made before quitting will be saved.

You can return to cluster setup at any time by typing "cluster setup".
To accept a default or omit a question, do not enter a value.

Do you want to create a new cluster or join an existing cluster? {create, join}:

Boot Loader version 4.3Copyright (C) 2000-2003 Broadcom Corporation.Portions Copyright (C) 2002-2014 NetApp, Inc. All Rights Reserved.CPU Type: Intel(R) Xeon(R) CPU C3528 @ 1.73GHzStarting AUTOBOOT press Ctrl-C to abort...Loading X86_64/freebsd/image1/kernel:0x200000/10341088 0xbdcae0/5815208 Entry at 0x80293660Loading X86_64/freebsd/image1/platform.ko:0x1169000/2266392 0x1393518/350312 0x13e8d80/269520Starting program at 0x80293660NetApp Data ONTAP 9.0Trying to mount root from msdosfs:/dev/da0s1 [ro]...md0 attached to /X86_64/freebsd/image1/rootfs.imgTrying to mount root from ufs:/env/md0.uzip []...mountroot: waiting for device /env/md0.uzip ...Copyright (C) 1992-2016 NetApp.All rights reserved.******************************** ** Press Ctrl-C for Boot Menu. ** ********************************Firewall rules loaded.qla_init_hw: CRBinit running ok: 8c633fNIC FW version in flash: 5.4.9qla_init_hw: CRBinit running ok: 8c633fNIC FW version bundled: 5.4.56Ipspace "ACP" createdlink speed 10GpsModule Type 10GBase-LRlink speed 10GpsModule Type 10GBase-LRWAFL CPLEDGER is enabled. Checklist = 0x7ff841ffSep 12 09:00:37 [localhost:cf.nm.nicReset:notice]: HA interconnect: Initiating soft reset on card 0 due to rendezvous reset.Sep 12 09:00:37 [localhost:cf.rv.notConnected:ALERT]: HA interconnect: Connection for 'cfo_rv' failed.add host 127.0.10.1: gateway 127.0.20.1Sep 12 09:00:40 [localhost:cf.fm.notkoverClusterDisable:error]: Failover monitor: takeover disabled (restart)Sep 12 09:00:40 [localhost:cf.nm.nicReset:notice]: HA interconnect: Initiating soft reset on card 0 due to rendezvous reset.boot_from_disk:last_booted_OS:9.0Sep 12 09:00:40 [localhost:kern.syslog.msg:notice]: The system was down for 168 secondsSep 12 09:00:40 [localhost:cf.rv.notConnected:ALERT]: HA interconnect: Connection for 'cfo_rv' failed.There are 14 spare disks; you may want to use the vol or aggr commandto create new volumes or aggregates or add disks to the existing aggregate.Sep 12 09:00:41 [localhost:cf.fsm.takeoverOfPartnerDisabled:error]: Failover monitor: takeover of partner disabled (Controller Failover takeover disabled).Sep 12 09:00:41 [localhost:kern.syslog.msg:notice]: domain xing mode: off, domain xing interrupt: falseSep 12 09:00:41 [localhost:clam.invalid.config:error]: Local node (name=unknown, id=0) is in an invalid configuration for providing CLAM functionality.CLAM cannot determine the identity of the HA partner.Adding /mroot/etc/swapfile as additional swapSep 12 09:01:00 [localhost:monitor.globalStatus.critical:EMERGENCY]: Controller failover partner unknown. Controller failover not possible.Welcome to the cluster setup wizard.You can enter the following commands at any time:"help" or "?" - if you want to have a question clarified,"back" - if you want to change previously answered questions, and"exit" or "quit" - if you want to quit the cluster setup wizard.Any changes you made before quitting will be saved.You can return to cluster setup at any time by typing "cluster setup".To accept a default or omit a question, do not enter a value.Do you want to create a new cluster or join an existing cluster? {create, join}:

cf status:

Spoiler

Takeover
Node Partner Possible State Description
-------------- -------------- -------- -------------------------------------
localhost - false Connected to partner. Waiting for
cluster applications to come online
on the local node. Offline
applications: mgmt, vldb, vifmgr,
bcomd, crs., Takeover is not
possible: Storage failover is
disabled

TakeoverNode Partner Possible State Description-------------- -------------- -------- -------------------------------------localhost - false Connected to partner. Waiting forcluster applications to come onlineon the local node. Offlineapplications: mgmt, vldb, vifmgr,bcomd, crs., Takeover is notpossible: Storage failover isdisabled

Sahana · ‎2016-10-13

Hi,

Please refer KB https://kb.netapp.com/support/s/article/what-does-error-cf-rv-notconnected-connection-for-cfo-rv-failed-mean?t=1476424220806

If this post resolved your issue, help others by selecting ACCEPT AS SOLUTION or adding a KUDO.

SEIMTEXTER · ‎2021-02-19

Sorry to necro this, but I've just run into this issue and the kb article linked above is now a dead link. Can anyone point me in the right direction? Is this error worthy of concern?

Thank you!