<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic grafana/netapp-harvest incomplete data gathered in Active IQ Unified Manager Discussions</title>
    <link>https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/grafana-netapp-harvest-incomplete-data-gathered/m-p/136089#M24680</link>
    <description>&lt;P&gt;Hello,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;I've setup Grafana + Graphite + Netapp-Harvest with SDK 5.7 and all looks to be working fine.&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;I've discovered that sometimes data is missing in-between. This was discovered first using Graphana (that some lines stopped) in the graph. Then after some more investigation we discovered that this data is not present in Graphite.&lt;/P&gt;&lt;P&gt;Checking NMON for system performance doesn't directly show us any issues with CPU or Memory during those periods so it must be something else.&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;Is this a common issue? Is this something we can debug?&lt;BR /&gt;I've looked in all the logs of graphite and netapp-harvest but I do not see any warnings or errors that could explain or be related to the issues we're seeing.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;We've tried several settings in carbon.conf (with restart after changes) eg.&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;MAX_UPDATES_PER_SECOND was set from 500, to 1000, 10000 and now 50000 but it doesn't seem to make any difference.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Same counts for&amp;nbsp;MAX_CREATES_PER_MINUTE; inital settings 600 but with 1200, 5000 and 10000 (now) nothing has changed.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;I checked the logs (eg. console.log) but do not see any error or warning messages which indicate an issue, limit or problem.&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;In the image attached (I had to partly remove the names because of security reasons) you can see that Read Latency and Write Latency are missing data; while they do have data of the throughput (same volume), there's no data about the latency of that read/write. These are the graphs of Dashboard 'Volume', section 'Top Volume Backend WAFL Layer Drilldown'.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Kind regards,&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Dennis&lt;/SPAN&gt;&lt;/P&gt;</description>
    <pubDate>Wed, 04 Jun 2025 14:20:26 GMT</pubDate>
    <dc:creator>DennisFokker</dc:creator>
    <dc:date>2025-06-04T14:20:26Z</dc:date>
    <item>
      <title>grafana/netapp-harvest incomplete data gathered</title>
      <link>https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/grafana-netapp-harvest-incomplete-data-gathered/m-p/136089#M24680</link>
      <description>&lt;P&gt;Hello,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;I've setup Grafana + Graphite + Netapp-Harvest with SDK 5.7 and all looks to be working fine.&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;I've discovered that sometimes data is missing in-between. This was discovered first using Graphana (that some lines stopped) in the graph. Then after some more investigation we discovered that this data is not present in Graphite.&lt;/P&gt;&lt;P&gt;Checking NMON for system performance doesn't directly show us any issues with CPU or Memory during those periods so it must be something else.&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;Is this a common issue? Is this something we can debug?&lt;BR /&gt;I've looked in all the logs of graphite and netapp-harvest but I do not see any warnings or errors that could explain or be related to the issues we're seeing.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;We've tried several settings in carbon.conf (with restart after changes) eg.&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;MAX_UPDATES_PER_SECOND was set from 500, to 1000, 10000 and now 50000 but it doesn't seem to make any difference.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Same counts for&amp;nbsp;MAX_CREATES_PER_MINUTE; inital settings 600 but with 1200, 5000 and 10000 (now) nothing has changed.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;I checked the logs (eg. console.log) but do not see any error or warning messages which indicate an issue, limit or problem.&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;In the image attached (I had to partly remove the names because of security reasons) you can see that Read Latency and Write Latency are missing data; while they do have data of the throughput (same volume), there's no data about the latency of that read/write. These are the graphs of Dashboard 'Volume', section 'Top Volume Backend WAFL Layer Drilldown'.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Kind regards,&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Dennis&lt;/SPAN&gt;&lt;/P&gt;</description>
      <pubDate>Wed, 04 Jun 2025 14:20:26 GMT</pubDate>
      <guid>https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/grafana-netapp-harvest-incomplete-data-gathered/m-p/136089#M24680</guid>
      <dc:creator>DennisFokker</dc:creator>
      <dc:date>2025-06-04T14:20:26Z</dc:date>
    </item>
  </channel>
</rss>

