topic Re: Will Harvest/Graphite get me protocol "Top Talkers"? in Active IQ Unified Manager Discussions

Will Harvest/Graphite get me protocol "Top Talkers"?

dmchyla — Mon, 26 Oct 2015 16:26:40 GMT

We have a customer on CDOT 8.2 that needs to know "top talkers" for CIFS. This was available in 7-mode, and I have heard that it will make it back into a future release of CDOT (can't currently get this from OPM). I have not had a chance to spin up a lab to test it out, but I'm wondering if I can get this data via Harvest/Graphite/Grafana.

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

madden — Wed, 28 Oct 2015 10:11:55 GMT

Hi,

By top talkers I assume you mean top clients.

In 8.2 you can view ops from the CLI; see KB1014391 for more. My experience is that cifs_ops doesn't increment, but total_ops does and nlm_ops does, so maybe you can use those.

In 8.3 you can view ops from the CLI using the normal statistics interface and the "clients" object. My experience is CIFS stats do increment.

In 8.2 there is no API interface to get the stats, so Harvest can't collect. In 8.3 there is, but so far I haven't had enough demand to add it, so not there today either. Someone can however add it themselves, or if enough people speak up I can add it in a future release.

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

mzp45 — Wed, 09 Dec 2015 18:45:09 GMT

Chris,

I think the top talkers graph would be invaluable. It'd be great if it was included in the next release.

Also another thing that could be included is all of the E/EF series data. Right now i have to use the API and some scripting to send all of the Eseries data to graphite. However if Harvest was confgured to pull that data and if the pre made dashboards were available, it''d reduce all of the script/dashboard maintenance work.

Thanks

btw the harvest tool is great, far better than any existing solution going around.

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

ChristianMe — Thu, 17 Dec 2015 15:18:02 GMT

Hello, could someone me explain how I can connect the eseries to graphite / grafana. Thank you Chris!

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

madden — Thu, 17 Dec 2015 15:33:07 GMT

@ChristianMe,

A colleague wrote an E-Series collector and we are currently refactoring it into Harvest for release. So I fully expect it to be in a future version of Harvest but unfortunately don't have a date for you right now. We are using the SMI-S Server as our proxy to the E-Series, but the Web Services Server is also possible. So if you have an urgent need you could look at one of those to grab data and post to Graphite in the meantime.

Cheers,
Chris Madden

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

ChristianMe — Thu, 17 Dec 2015 15:36:17 GMT

@madden Thank you for your quick responce! In this case I'm waiting for the next release.
Chris

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

MARTINLEGGATT — Thu, 28 Jan 2016 09:33:04 GMT

Looking to monitor our E-series in Grafana/Graphite.

Is there an estimate on when the release of Harvest script will be out?

Thanks

Martin

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

madden — Sat, 30 Jan 2016 22:44:55 GMT

@MARTINLEGGATT,

Sorry, no update on E-Series yet, the colleague who wrote it was out of the office for some weeks but is back now so hopefully it won't be too much longer.

Regards,

Chris

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

SrikanthReddy — Wed, 22 Feb 2017 16:22:02 GMT

We would also like to have protocol top talkers

if this is planned in any future release ?

Thanks

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

madden — Mon, 24 Apr 2017 08:25:56 GMT

Hi @SrikanthReddy

The list of top files and top clients has changing instance names and is poorly suited for use with Graphite [where you would end up with potentially hundreds of thousands of .wsp files with just a few data points in them].

If you need top files or clients I would write a script and put this data into Elasticsearch or similar because these can easily handle indexing with instance names that are frequently changing.

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

SrikanthReddy — Mon, 24 Apr 2017 17:25:35 GMT

Thanks Chris

could you share when you get to have script data with elastic search

Re: Will Harvest/Graphite get me protocol "Top Talkers"?

madden — Mon, 24 Apr 2017 18:08:26 GMT

Hi @SrikanthReddy

Sorry, I haven't written this script but it is the approach I would take if I had this problem to solve!

Cheers,
Chris