Active IQ Unified Manager Discussions

NetApp Harvest - Grafana - Ignore selected volumes

Mal-R
5,897 Views

HI All,

 

Using Harvest has been invaluable and helped us deep dive on a number of problems.

 

Monitoring 12- 14 clusters I have an issue with volume numbers.

 

Harvest traps every volume including temporoary volumes cloned from backups by CommVault.

 

The problem is that there are so many volumes (even in one SVM) the dropdown volume list truncates around 800 volumes.

 

I there a way to filter out volumes with a prefix so they are not recorded in by Harvest?

There are specific prefixes.

 

Cheers

 

1 ACCEPTED SOLUTION

madden
5,844 Views

Hi @Mal-R

 

Harvest does not have a feature to exclude collection of specific instances, but you can configure the Graphite server to drop them by using the blacklist feature.  Details on how to set this up are in the Harvest 1.3 Administration guide on pg 24 " Use a blacklist to prevent visibility of temporary volumes [optional] ".  If you have stale metrics you might also like to delete them as a one time action and setup in cron using details on pg 25 in "Purging inactive metrics from Graphite [optional]"

 

Hope this helps!

 

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

View solution in original post

4 REPLIES 4

madden
5,845 Views

Hi @Mal-R

 

Harvest does not have a feature to exclude collection of specific instances, but you can configure the Graphite server to drop them by using the blacklist feature.  Details on how to set this up are in the Harvest 1.3 Administration guide on pg 24 " Use a blacklist to prevent visibility of temporary volumes [optional] ".  If you have stale metrics you might also like to delete them as a one time action and setup in cron using details on pg 25 in "Purging inactive metrics from Graphite [optional]"

 

Hope this helps!

 

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Mal-R
5,795 Views

Hi Chris,

 

Have updated the blacklist and removed the stagnant commvault files adn created the cron.

 

Grafana directory structure almost halved in size and drilldown to volume level is much faster.

 

Thank You

Mal

Mal-R
5,629 Views

Hi Chris,

 

I've setup a blacklist however it does not seem to ignore volumes.

What have I got wrong?

 

Blacklist entry

 

^netapp\.(capacity|perf)\..+\.vol\..+CVclone\..+

 

I Still get samples like below created 

 

/opt/graphite/storage/whisper/netapp/./capacity/iaxxx_xx1/bsgpp1estcp01/svm/xxxinfvsv003/vol/xxxinf_vmdata_0128_SP_2_672752_476027_1499521274_CVclone

 

 

madden
5,554 Views

 

Hi @Mal-R

 

A colleague set up blacklisting at a customer with CommValut and reported that this worked for him:

 

^netapp\.(capacity|perf7?)\..+\.vol\..+_CVclone\..+

I would check the Graphite Carbon creates.log in /var/log/carbon  or /opt/graphite/storage/log/carbon-cache/carbon-cache-a to see if helps show what is happening.

 

 

Cheers,
Chris

Public