Will Harvest/Graphite get me protocol "Top Talkers"?

[dmchyla]

We have a customer on CDOT 8.2 that needs to know "top talkers" for CIFS. This was available in 7-mode, and I have heard that it will make it back into a future release of CDOT (can't currently get this from OPM). I have not had a chance to spin up a lab to test it out, but I'm wondering if I can get this data via Harvest/Graphite/Grafana.

[madden]

Hi,

By top talkers I assume you mean top clients.

In 8.2 you can view ops from the CLI; see KB1014391 for more.  My experience is that cifs_ops doesn't increment, but total_ops does and nlm_ops does, so maybe you can use those.  

In 8.3 you can view ops from the CLI using the normal statistics interface and the "clients" object.  My experience is CIFS stats do increment.

In 8.2 there is no API interface to get the stats, so Harvest can't collect.  In 8.3 there is, but so far I haven't had enough demand to add it, so not there today either.  Someone can however add it themselves, or if enough people speak up I can add it in a future release.

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

[mzp45]

Chris,

I think the top talkers graph would be invaluable. It'd be great if it was included in the next release.

Also another thing that could be included is all of the E/EF series data. Right now i have to use the API and some scripting to send all of the Eseries data to graphite. However if Harvest was confgured to pull that data and if the pre made dashboards were available, it''d reduce all of the script/dashboard maintenance work. 

Thanks 

btw the harvest tool is great, far better than any existing solution going around. 

[ChristianMe]

Hello, could someone me explain how I can connect the eseries to graphite / grafana. Thank you Chris!

[madden]

@ChristianMe,

A colleague wrote an E-Series collector and we are currently refactoring it into Harvest for release.  So I fully expect it to be in a future version of Harvest but unfortunately don't have a date for you right now.  We are using the SMI-S Server as our proxy to the E-Series, but the Web Services Server is also possible.  So if you have an urgent need you could look at one of those to grab data and post to Graphite in the meantime.

Cheers,
Chris Madden

[ChristianMe]

@madden Thank you for your quick responce! In this case I'm waiting for the next release.
Chris

[MARTINLEGGATT]

Looking to monitor our E-series in Grafana/Graphite.  

Is there an estimate on when the release of Harvest script will be out?

Thanks

Martin

[madden]

@MARTINLEGGATT,

Sorry, no update on E-Series yet, the colleague who wrote it was out of the office for some weeks but is back now so hopefully it won't be too much longer.

Regards,

Chris

[SrikanthReddy]

We would also like to have protocol top talkers

if this is planned in  any future release ?

Thanks

[madden]

Hi @SrikanthReddy

The list of top files and top clients has changing instance names and is poorly suited for use with Graphite [where you would end up with potentially hundreds of thousands of .wsp files with just a few data points in them].  

If you need top files or clients I would write a script and put this data into Elasticsearch or similar because these can easily handle indexing with instance names that are frequently changing.

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

[SrikanthReddy]

Thanks Chris

could you  share when you get to have script data  with elastic search 

[madden]

Hi @SrikanthReddy

Sorry, I haven't written this script but it is the approach I would take if I had this problem to solve!

Cheers,
Chris