NetApp Harvest - Grafana - Ignore selected volumes

[Mal-R]

HI All,

Using Harvest has been invaluable and helped us deep dive on a number of problems.

Monitoring 12- 14 clusters I have an issue with volume numbers.

Harvest traps every volume including temporoary volumes cloned from backups by CommVault.

The problem is that there are so many volumes (even in one SVM) the dropdown volume list truncates around 800 volumes.

I there a way to filter out volumes with a prefix so they are not recorded in by Harvest?

There are specific prefixes.

Cheers

[madden · Accepted solution]

Hi @Mal-R

Harvest does not have a feature to exclude collection of specific instances, but you can configure the Graphite server to drop them by using the blacklist feature.  Details on how to set this up are in the Harvest 1.3 Administration guide on pg 24 " Use a blacklist to prevent visibility of temporary volumes [optional] ".  If you have stale metrics you might also like to delete them as a one time action and setup in cron using details on pg 25 in "Purging inactive metrics from Graphite [optional]"

Hope this helps!

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

[Mal-R]

Hi Chris,

Have updated the blacklist and removed the stagnant commvault files adn created the cron.

Grafana directory structure almost halved in size and drilldown to volume level is much faster.

Thank You

Mal

[Mal-R]

Hi Chris,

I've setup a blacklist however it does not seem to ignore volumes.

What have I got wrong?

Blacklist entry

^netapp\.(capacity|perf)\..+\.vol\..+CVclone\..+

I Still get samples like below created 

/opt/graphite/storage/whisper/netapp/./capacity/iaxxx_xx1/bsgpp1estcp01/svm/xxxinfvsv003/vol/xxxinf_vmdata_0128_SP_2_672752_476027_1499521274_CVclone

[madden]

Hi @Mal-R

A colleague set up blacklisting at a customer with CommValut and reported that this worked for him:

^netapp\.(capacity|perf7?)\..+\.vol\..+_CVclone\..+

I would check the Graphite Carbon creates.log in /var/log/carbon  or /opt/graphite/storage/log/carbon-cache/carbon-cache-a to see if helps show what is happening.

Cheers,
Chris