https://community.netapp.com/t5/ONTAP-Hardware/Controller-Giveback-issues/m-p/118904#M7380 <P>it looks like a hw issue/bug. try to reboot the whole cluster; if persist, you might need to replace the mb. so you might need&nbsp;to open a case.</P> Tue, 03 May 2016 09:28:47 GMT Jeff_Yao 2016-05-03T09:28:47Z https://community.netapp.com/t5/ONTAP-Hardware/Controller-Giveback-issues/m-p/118772#M7372 <P>We are working on&nbsp;&nbsp;FAS3240 (running 8.1.1P1 in 7-Mode) in which a controller has failed due to cache battery. &nbsp;Currently node1 has taken over for the failed node. &nbsp;The cache battery issue has been resolved, but we seem to be having some odd issues trying to do the giveback. &nbsp;When the giveback happened, it seemed to succeed the other night, but the LUNs were not accessable on node2. &nbsp;From there the controller was halted and everything came back online on the node1 in a failed over state</P><P>&nbsp;</P><P>It seems there has been an "unsynchronized log" event going on for sometime. &nbsp;Assuming this had to be related to &nbsp;an interconnect issues we have swaped out the twinax interconnect cables, verified c0a --&gt; c0a, and c0b --&gt; c0b, but still seeing some odd behavior (same with previous cables). &nbsp;It doesnt appear the nodes can communicate:</P><P>&nbsp;</P><P class="p1"><SPAN class="s1">1: Error logs are showing a failed RDMA (cluster) connection repeatedly:</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">Wed Apr 27 00:16:07 PDT [node01:ems.engine.suppressed:debug]: Event 'ctrl.rdma.failConnect' suppressed 3807 times in last 601 seconds.</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">2: `ic status` is showing a flapping link 0 (and sometimes link 1):</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic status</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 0: down</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 1: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; IC RDMA connection : down</SPAN></P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic status</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 0: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 1: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; IC RDMA connection : down</SPAN></P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic status</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 0: down</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 1: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; IC RDMA connection : down</SPAN></P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic status</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 0: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 1: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; IC RDMA connection : down</SPAN></P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic status</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 0: down</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Link 1: up</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; IC RDMA connection : down</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">3: `ic stats error` shows disconnects</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Connection state : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Disconnected</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Connections made : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;2</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; Software resets : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 2</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">4: Dumping interconnect stats shows a large increment in connection errors</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic dump hw_stats</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; Connection Error : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 64761483</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; SQ Overrun Error : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 70494545368</SPAN></P><P class="p1"><SPAN class="s1">[snip]</SPAN></P><P class="p1"><SPAN class="s1">[5 seconds later]</SPAN></P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; ic dump hw_stats</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; Connection Error : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 64761514</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; SQ Overrun Error : &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 70494545368</SPAN></P><P class="p1"><SPAN class="s1">[snip]</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">5: Cannot send any data over the interconnect</SPAN></P><P class="p2">&nbsp;</P><P class="p1"><SPAN class="s1">node01(takeover)*&gt; icbulk send 30 20 200</SPAN></P><P class="p1"><SPAN class="s1">&nbsp; &nbsp; &nbsp; &nbsp; 0 messages sent, &nbsp; 0 MB/s</SPAN></P><P class="p1">&nbsp;</P><P class="p1">&nbsp;</P><P class="p1"><SPAN class="s1">Other errors we were seeing on this prior to failure:</SPAN></P><P class="p1">&nbsp;</P><P class="p1">[interconnect stats]</P><P class="p1">Connection state :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Established</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Connection attempts :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Connections made :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Connections lost:&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;0</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Software resets :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Max connection time :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 msec</P><P class="p1">&nbsp;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; --- EMS Error Stats: ---</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NIC transition for Port 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NIC transition for Port 1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; VI error for NIC 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; VI error for NIC 1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NIC reset&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC vi_if init failure&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC hearbeat failure&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1"><STRONG>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC transfer timed out&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:1962&nbsp;&nbsp; Last Updated: Mon Nov 30 01:18:20 PST 2015</STRONG></P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC init failure&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC client init failure&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC disabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC invalid source address&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC misconfigured&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC ports corss connected&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC ports loopback&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RV version mismatch&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RV partner not connected&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RV local not connected&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp; &nbsp;Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; RV not connected&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; vi_if descriptor allocation failure&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Max_xig threshold:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 12</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Enable OFW status reads :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TRUE TRUE</P><P class="p1">&nbsp;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; --- General Error Stats: ---</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; VI Fatal error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Memory registration failure&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1"><STRONG>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Connection down error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:25981756&nbsp;&nbsp; Last Updated: Mon Dec 28 05:41:21 PST 2015</STRONG></P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Notify timeout error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Bad descriptor error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Bad descriptor id&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; No descriptor error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Recv descriptor error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1"><STRONG>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Send descriptor error&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:1213206&nbsp;&nbsp; Last Updated: Mon Nov 30 01:18:20 PST 2015</STRONG></P><P class="p1"><STRONG>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Send descriptor timeout&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:3222&nbsp;&nbsp; Last Updated: Mon Nov 30 01:18:20 PST 2015</STRONG></P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; vi_if invalid packet&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; vi_if invalid data&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Kstat recv timeout&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IC NV unsync&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Count:&nbsp; 0&nbsp;&nbsp; Last Updated: &lt;No Update&gt;</P><P class="p1">&nbsp;</P><P class="p1">&nbsp;</P><P class="p1">Looking for any thoughts here ...&nbsp;</P> Wed, 04 Jun 2025 21:13:08 GMT https://community.netapp.com/t5/ONTAP-Hardware/Controller-Giveback-issues/m-p/118772#M7372 scott_mcisaac 2025-06-04T21:13:08Z https://community.netapp.com/t5/ONTAP-Hardware/Controller-Giveback-issues/m-p/118904#M7380 <P>it looks like a hw issue/bug. try to reboot the whole cluster; if persist, you might need to replace the mb. so you might need&nbsp;to open a case.</P> Tue, 03 May 2016 09:28:47 GMT https://community.netapp.com/t5/ONTAP-Hardware/Controller-Giveback-issues/m-p/118904#M7380 Jeff_Yao 2016-05-03T09:28:47Z