https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/Harvest-Graphite-Outlier-Issue/m-p/135687#M24595 <P>Hi All,</P><P>&nbsp;</P><P>I'm having a strange recurring issue where absurdly high metrics are getting placed into my harvest/graphite instance. I don't see any strange messages in the logs for the timeframes where it occurs.</P><P>&nbsp;</P><P>Has anyone seen anything similar? I have two clusters and it is happening with both. I have two screencaps below, the first is a 12 hour view, and the second is a 60 day view. It almost appears the outliers are just getting higher and higher with time? But I'm not sure if that is just some sort of rollup issue with graphite.</P><P>&nbsp;</P><P>I would love to be able to use this data- really the only reason I created the QOS polices was for this purpose, but it's almost impossible to parse with these outliers.</P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper" image-alt="12hr svm qos policy group" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7756i987A4EE8AD99DEBC/image-size/large?v=v2&amp;px=999" role="button" title="12hr svm qos policy group" alt="12hr svm qos policy group" /></span></P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper" image-alt="60 day history" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7757i38A829C9D493863E/image-size/large?v=v2&amp;px=999" role="button" title="60 day history" alt="60 day history" /></span></P><P>&nbsp;</P><P>edit: it looks like I can somewhat get around this issue by using the ''<A>removeAboveValue</A><SPAN>(</SPAN><A target="_blank">100000</A><SPAN>)" or "<A>removeAbovePercentile</A>(<A target="_blank">99.6</A>)" functions. However that doesn't negate the fact this erroroneous data is getting placed into graphite.</SPAN></P><P>&nbsp;</P><P><SPAN><span class="lia-inline-image-display-wrapper" image-alt="workaround" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7758i07F0648083C616D6/image-size/large?v=v2&amp;px=999" role="button" title="workaround" alt="workaround" /></span></SPAN></P> Wed, 04 Jun 2025 14:25:36 GMT maxxoverclocker 2025-06-04T14:25:36Z https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/Harvest-Graphite-Outlier-Issue/m-p/135687#M24595 <P>Hi All,</P><P>&nbsp;</P><P>I'm having a strange recurring issue where absurdly high metrics are getting placed into my harvest/graphite instance. I don't see any strange messages in the logs for the timeframes where it occurs.</P><P>&nbsp;</P><P>Has anyone seen anything similar? I have two clusters and it is happening with both. I have two screencaps below, the first is a 12 hour view, and the second is a 60 day view. It almost appears the outliers are just getting higher and higher with time? But I'm not sure if that is just some sort of rollup issue with graphite.</P><P>&nbsp;</P><P>I would love to be able to use this data- really the only reason I created the QOS polices was for this purpose, but it's almost impossible to parse with these outliers.</P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper" image-alt="12hr svm qos policy group" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7756i987A4EE8AD99DEBC/image-size/large?v=v2&amp;px=999" role="button" title="12hr svm qos policy group" alt="12hr svm qos policy group" /></span></P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper" image-alt="60 day history" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7757i38A829C9D493863E/image-size/large?v=v2&amp;px=999" role="button" title="60 day history" alt="60 day history" /></span></P><P>&nbsp;</P><P>edit: it looks like I can somewhat get around this issue by using the ''<A>removeAboveValue</A><SPAN>(</SPAN><A target="_blank">100000</A><SPAN>)" or "<A>removeAbovePercentile</A>(<A target="_blank">99.6</A>)" functions. However that doesn't negate the fact this erroroneous data is getting placed into graphite.</SPAN></P><P>&nbsp;</P><P><SPAN><span class="lia-inline-image-display-wrapper" image-alt="workaround" style="width: 999px;"><img src="https://community.netapp.com/t5/image/serverpage/image-id/7758i07F0648083C616D6/image-size/large?v=v2&amp;px=999" role="button" title="workaround" alt="workaround" /></span></SPAN></P> Wed, 04 Jun 2025 14:25:36 GMT https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/Harvest-Graphite-Outlier-Issue/m-p/135687#M24595 maxxoverclocker 2025-06-04T14:25:36Z