Time                Node             Severity      Event
------------------- ---------------- ------------- ---------------------------
9/26/2019 04:35:43  nmg-fas8040-02
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-02:dblade, rsp=nmg-fas8040-01:dblade, uniquifier=0d0593724dbeef8b) failed with record state ACTIVE and error CSM_CONNABORTED.
9/26/2019 04:34:51  nmg-fas8040-02
                                     ERROR         cf.hwassist.empty.MgmtAddr: Cannot find hardware-assist node management IP address for partner node.
9/26/2019 04:31:42  nmg-fas8040-02
                                     ERROR         acp.need.firmware.update: ACP module  (NA) needs a firmware upgrade, (disk shelf serial number: SHFMS1416001228).
9/26/2019 04:31:42  nmg-fas8040-02
                                     ERROR         acp.need.firmware.update: ACP module  (NA) needs a firmware upgrade, (disk shelf serial number: SHFMS1417000029).
9/26/2019 04:31:36  nmg-fas8040-01
                                     ERROR         cf.fsm.takeoverOfPartnerDisabled: Failover monitor: takeover of nmg-fas8040-02 disabled (unsynchronized log).
9/26/2019 04:31:34  nmg-fas8040-01
                                     ERROR         cf.fsm.takeoverByPartnerDisabled: Failover monitor: takeover of nmg-fas8040-01 by nmg-fas8040-02 disabled (unsynchronized log).
9/26/2019 04:31:32  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus3 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus3 (node nmg-fas8040-02).
9/26/2019 04:31:01  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus3 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus2 (node nmg-fas8040-02).
9/26/2019 04:30:29  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus3 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus1 (node nmg-fas8040-02).
9/26/2019 04:29:34  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus4 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus4 (node nmg-fas8040-02).
9/26/2019 04:29:03  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus4 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus3 (node nmg-fas8040-02).
9/26/2019 04:28:32  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus4 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus2 (node nmg-fas8040-02).
9/26/2019 04:28:01  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus4 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus1 (node nmg-fas8040-02).
9/26/2019 04:27:00  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus1 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus4 (node nmg-fas8040-02).
9/26/2019 04:26:28  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus1 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus3 (node nmg-fas8040-02).
9/26/2019 04:25:57  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus1 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus2 (node nmg-fas8040-02).
9/26/2019 04:25:26  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus1 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus1 (node nmg-fas8040-02).
9/26/2019 04:24:31  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus2 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus4 (node nmg-fas8040-02).
9/26/2019 04:24:00  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus2 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus3 (node nmg-fas8040-02).
9/26/2019 04:23:55  nmg-fas8040-01
                                     ERROR         mgmtgwd.vreport.nodesUnreachable: Vreport encountered some unreachable nodes. The report may be incomplete.
9/26/2019 04:23:29  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus2 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus2 (node nmg-fas8040-02).
9/26/2019 04:23:09  nmg-fas8040-01
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-01:nblade, rsp=nmg-fas8040-02:dblade, uniquifier=00056182010da0ac) failed with record state ACTIVE and error CSM_CONNABORTED.
9/26/2019 04:22:58  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus2 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus1 (node nmg-fas8040-02).
9/26/2019 04:22:02  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedall: Total packet loss when pinging from cluster lif nmg-fas8040-01_clus3 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus4 (node nmg-fas8040-02).
9/26/2019 04:22:00  nmg-fas8040-01
                                     EMERGENCY     monitor.globalStatus.critical: This node has taken over nmg-fas8040-02.
9/26/2019 04:21:49  nmg-fas8040-01
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-01:dblade, rsp=nmg-fas8040-02:dblade, uniquifier=0b05618200bfa40f) failed with record state ACTIVE and error CSM_CONNABORTED.
9/26/2019 04:21:47  nmg-fas8040-01
                                     ALERT         vifmgr.cluscheck.droppedlarge: Partial packet loss when pinging from cluster lif nmg-fas8040-01_clus3 (node nmg-fas8040-01) to cluster lif nmg-fas8040-02_clus3 (node nmg-fas8040-02).
9/26/2019 04:21:47  nmg-fas8040-01
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-01:dblade, rsp=nmg-fas8040-02:dblade, uniquifier=0f05618200bfa7f2) failed with record state ACTIVE and error CSM_CONNABORTED.
9/26/2019 04:21:47  nmg-fas8040-01
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-01:dblade, rsp=nmg-fas8040-02:dblade, uniquifier=1005618200bfa7f2) failed with record state ACTIVE and error CSM_CONNABORTED.
                                     EMERGENCY     callhome.sfo.takeover.panic: Call home for CONTROLLER TAKEOVER COMPLETE PANIC
9/26/2019 04:21:42  nmg-fas8040-01
                                     ERROR         csm.sessionFailed: Cluster interconnect session (req=nmg-fas8040-01:scsiblade, rsp=nmg-fas8040-02:dblade, uniquifier=0a056182024a9470) failed with record state ACTIVE and error CSM_CONNABORTED.
9/26/2019 04:21:30  nmg-fas8040-01
                                     EMERGENCY     clam.node.ooq: Node (name=nmg-fas8040-02, ID=1001) is out of "CLAM quorum" (reason=seen by HA partner).
9/26/2019 04:21:30  nmg-fas8040-01
                                     EMERGENCY     callhome.clam.node.ooq: Call home for NODE(S) OUT OF CLUSTER QUORUM.
9/26/2019 04:21:30  nmg-fas8040-01
                                     ALERT         cf.fsm.takeover.panic: Failover monitor: takeover attempted after partner panic.
9/26/2019 04:21:29  nmg-fas8040-02
                                     ALERT         sk.panic: Panic String: Process mgwd unresponsive for 927 seconds in process nodewatchdog on release 9.2 (C)
9/26/2019 04:21:29  nmg-fas8040-02
                                     ALERT         nodewatchdog.node.panic: Data ONTAP has experienced a serious internal error: Process mgwd unresponsive for 927 seconds. This might cause the node experiencing the problem to become unresponsive to data access. The node has been panicked to prevent this condition from continuing.
9/26/2019 04:14:32  nmg-fas8040-02
                                     ALERT         nodewatchdog.svc.rpc.noresp: The vifmgr service internal to Data ONTAP that is required for continuing data service was unavailable. The service failed, but was unsuccessfully restarted.
9/26/2019 04:11:29  nmg-fas8040-02
                                     ALERT         nodewatchdog.svc.rpc.noresp: The mgwd service internal to Data ONTAP that is required for continuing data service was unavailable. The service failed, but was unsuccessfully restarted.