Active IQ Unified Manager Discussions

netapp-harvest

Daveatenergy

HTTP Error

Internal Server Error

 

I can not get havest to connect to my datastore. 

 

 

1 ACCEPTED SOLUTION

madden

Yes!  You have data flowing in now!!  I would restart it now without the verbose (-v) flag.  

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

View solution in original post

30 REPLIES 30

flavio
Hi guys, Could someone help me on this... I have installed Grafana + Graphite + NetApp Harvest in a Linux host (RHEL 7.4) 3 days ago. Everything was running fine for 3 days. But today I started seeing the message "No data to show" in some dashboards. Some databoards are normal. For example, the dashboard "Cluster" says "No data to show", but the dashboard "Cluster Group" works without any issue. I was searching in the logs but I didnt find any message to help me on this. So far I have no idea if it's a problem in Grafana, Graphite or NetApp Harvest. I appreciate if someone can help me. Thanks a lot. Flávio Onofre de Souza

nicholsongc

Thank you @madden!  I've moved from NetApp PSC to customer so I appreciate the assitance.  Harvest is up and running now I'm hitting error 13001 trying to get OCUM 6.2P1 configured for capacity.

 

I got the same error trying to add 7-mode systems to Harvest until Yann enlightened me that I needed TLS enabled.  Does anyone have any guidance on what I need to do to get OCUM 6.2P1 configured for Harvest?  I have both a cDOT and 7-Mode of OCUM running currently.

madden

Hi @nicholsongc

 

You are running an older version of OCUM and probably hitting this issue:

http://community.netapp.com/t5/OnCommand-Storage-Management-Software-Discussions/Be-aware-that-upgrading-to-OnCommand-6-2P1-might-bring-major-issues/t...

 

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

 

 

 

nicholsongc

Actually the SDK seems to install quite nicely using the Admin GUI.  I have since re-deployed the OVA (2.1.5) to start with a clean slate.

 

So I go to the Admin GUI and install the SDK v5.6

I know I can't install Harvest using the GUI so I use the GUI just to download/extract the Harvest files to /tmp/upgrade-bundle then I install Harvest manually per the Harvest Admin Guide.

 

I run the command for Ubuntu logged into the ADVA concole as 'root':

 

dpkg -i netapp-harvest_1.3_all.deb

 

and I get this error:

 

dpkg: error processing archive netapp-harvest_1.3_all.deb (--install):

  cannot access archive: No such file or directory

Errors were encountered while processing:

netapp-harvest_1.3_all.deb

 

I recall deploying the OVA being a LOT more simpler than this as recently as last year.

madden

Hi @nicholsongc

 

 

The ADVA expects you to load the SDK and Harvest using the maintenance GUI.

 

Load NetApp Harvest and the SDK from the tools->Maintenance tab, “upload package” button, and then after uploaded the “upgrade now” button. 

 

The ADVA will unpack and install the software for you.  The files to upload are:

  1. Harvest: Load the netapp-harvest.tgz file from inside the zip bundle you downloaded from the toolchest
  2. SDK: load the entire SDK .zip file you downloaded from the toolchest

The Harvest part can be a little confusing because when Yann released the OVA I only had a tgz package format for the software.  In v1.3 I created native package formats but when I tried to have these posted to the Toolchest I learned they don't support file formats like .deb, so I decided to put all the installer types into one zip file.  So for clarity, you need to upload the tgz file to the ADVA and it should work!

 

I think Yann explains it in the video on his blog: http://ybontap.tynsoe.org/wordpress/graphite-va/

 

Cheers,
Chris Madden

Solution Architect - 3rd Platform - Systems Engineering NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

 

 

nicholsongc

Deployed the 2.1.5 OVA, installed NMSDK via the GUI and Harvest 1.3 via CLI.  Trying to get Harvest to start but getting the following:

 

root@cbivadva01eus:/opt/netapp-harvest# ./netapp-manager -start
STATUS          POLLER               GROUP
############### #################### ##################
[STARTED]       CLUSTER01            US
Can't locate NaServer.pm in @INC (you may need to install the NaServer module) (@INC contains: /opt/netapp-harvest/lib /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.20.2 /usr/local/share/perl/5.20.2 /usr/lib/x86_64-linux-gnu/perl5/5.20 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl/5.20 /usr/share/perl/5.20 /usr/local/lib/site_perl .) at /opt/netapp-harvest/netapp-worker line 37.
BEGIN failed--compilation aborted at /opt/netapp-harvest/netapp-worker line 37.

root@cbivadva01eus:/opt/netapp-harvest# ./netapp-manager -status
STATUS          POLLER               GROUP
############### #################### ##################
[NOT RUNNING]   CLUSTER01            US

 

Where can I start to look for a resolution... pretty sure I've overlooked something here but I'm at a loss for what it might be at the moment.

krishgudd

I ran in to same issue and part of troubleshooting i found library files are not loading/detecting  properly.

 

Download the available SDK from NetApp site and execute the below commands.

 

### Download from the NetApp Support Site and install using (modify version if needed):

 

unzip -j netapp-manageability-sdk-5.6.zip netapp-manageability-sdk-5.6/lib/perl/NetApp/* -d /opt/netapp-harvest/lib

 

restart netaapp-harvest service.

 

If possible take backup of existing SDK lib directory.

 

 

moep

The error indicates that harvest can't find the SDK in any perl include path.

madden

Hi @Daveatenergy

 

It sounds like your Graphite/Grafana server is not setup correctly.  Have you checked the troubleshooting steps in the Quick Start guide?

 

If you can check the logfiles (see the quick start guide) and share a more detailed error message maybe someone can help with how to fix.

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Daveatenergy

I've been through both guides numerious times.  My import seems to work, however look at the attached screenshot.  

 

root@Netappharvest1:/home/ddurand# cat /var/log/grafana/grafana.log
2016/06/14 07:55:44 [I] Completed 172.29.40.40 admin "GET /logout HTTP/1.1" 302 Found 29 bytes in 1378us
2016/06/14 08:10:21 [I] Completed 172.29.40.40 admin "GET /api/dashboards/db/new-dashboard HTTP/1.1" 404 Not Found 33 bytes in 872us
2016/06/14 09:27:31 [I] Completed 172.29.40.40 admin "GET /api/datasources/5 HTTP/1.1" 404 Not Found 35 bytes in 1214us


root@Netappharvest1:/home/ddurand# cat /var/log/carbon/listener.log.2016_6_8
08/06/2016 07:25:51 :: MetricLineReceiver connection with 127.0.0.1:47796 established
08/06/2016 07:25:51 :: MetricLineReceiver connection with 127.0.0.1:47796 closed cleanly

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to http://172.29.40.246:443
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-detail-volume.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-windows-file-services.json] successfully
[OK ] Imported dashboard [db_netapp-detail-graphite-server.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-svm.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-node.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-harvest-poller.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-lif.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-volume.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-node.json] successfully

madden

Hi @Daveatenergy

 

 

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to http://172.29.40.246:443

 

Looks like a mismatch in red.  In netapp-harvest.conf try setting grafana_url parameter to use https.  You are not alone in this mismatch have already updated netapp-manager to be more helpful in case (it will be in the next release) and will also update the quickstart defaults to match the harvest user guide example syntax.

 

Hope that solves your issue!

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Daveatenergy

Okay, I changed that up and received this:

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to https://172.29.40.246
[ERROR ] Failed to import dashboard [db_netapp-dashboard-7-mode-group.json] due to error: 401 Unauthorized
[ERROR ] -Response was :{"message":"Invalid API key"}

madden

Hi @Daveatenergy

 

 

My guess is something went wrong with your copy/paste of the API key from the Grafana Web UI and pasted as the value for the grafana_api_key variable in the netapp-harvest.conf file.  I would create a new API key in Grafana and apply it again being sure the entire string is copy/pasted. 

 

Hope this helps.

 

Cheers,
Chris

Daveatenergy

I now have imported dashboards.  However, they are not populated with anything.  

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to https://172.29.40.246
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-detail-volume.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-windows-file-services.json] successfully
[OK ] Imported dashboard [db_netapp-detail-graphite-server.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-svm.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-node.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-harvest-poller.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-lif.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-volume.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-node.json] successfully
root@Netappharvest1:/home/ddurand#

Daveatenergy

But I am seeing this.

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -stop
STATUS POLLER SITE
############### #################### ##################
[STOPPED] cluster_mgmt OR
root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -start
STATUS POLLER SITE
############### #################### ##################
[STARTED] cluster_mgmt OR
root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-worker -poller cluster_mgmt -v
[2016-06-14 12:16:18] [NORMAL ] WORKER STARTED [Version: 1.2.2] [Conf: netapp-harvest.conf] [Poller: cluster_mgmt]
[2016-06-14 12:16:18] [WARNING] Started in foreground mode; messages to STDERR are redirected to the logfile and are not visible on the console.
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [19] is Section [global]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [20] in Section [global] has Key/Value pair [grafana_api_key]=[eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [21] in Section [global] has Key/Value pair [grafana_url]=[https://172.29.40.246]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [22] in Section [global] has Key/Value pair [grafana_dl_tag]=[]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [28] is Section [default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [30] in Section [default] has Key/Value pair [graphite_enabled]=[1]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [31] in Section [default] has Key/Value pair [graphite_server]=[172.29.40.246]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [32] in Section [default] has Key/Value pair [graphite_port]=[2003]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [33] in Section [default] has Key/Value pair [graphite_proto]=[tcp]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [34] in Section [default] has Key/Value pair [normalized_xfer]=[mb_per_sec]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [35] in Section [default] has Key/Value pair [normalized_time]=[millisec]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [36] in Section [default] has Key/Value pair [graphite_root]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [37] in Section [default] has Key/Value pair [graphite_meta_metrics_root]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [40] in Section [default] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [41] in Section [default] has Key/Value pair [host_port]=[443]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [42] in Section [default] has Key/Value pair [host_enabled]=[1]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [43] in Section [default] has Key/Value pair [template]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [44] in Section [default] has Key/Value pair [data_update_freq]=[60]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [45] in Section [default] has Key/Value pair [ntap_autosupport]=[0]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [46] in Section [default] has Key/Value pair [latency_io_reqd]=[10]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [47] in Section [default] has Key/Value pair [auth_type]=[password]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [48] in Section [default] has Key/Value pair [username]=[admin]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [49] in Section [default] has Key/Value pair [password]=[**********]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [60] is Section [cluster_mgmt]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [61] in Section [cluster_mgmt] has Key/Value pair [hostname]=[192.168.110.50]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [62] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [67] in Section [cluster_mgmt] has Key/Value pair [hostname]=[172.29.40.60]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [68] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [69] in Section [cluster_mgmt] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [70] in Section [cluster_mgmt] has Key/Value pair [data_update_freq]=[900]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [71] in Section [cluster_mgmt] has Key/Value pair [normalized:_xfer]=[gb_per_sec]
[2016-06-14 12:16:18] [NORMAL ] [main] Poller will monitor a [OCUM] at [172.29.40.60:443]
[2016-06-14 12:16:18] [NORMAL ] [main] Poller will use [password] authentication with username [admin] and password [**********]
[2016-06-14 12:16:18] [DEBUG ] [connect] Reverse hostname lookup successful. Using HTTP/1.1 for communication.
[2016-06-14 12:16:18] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:18] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:18] [WARNING] [main] system-info update failed; will try again in 10 seconds.
[2016-06-14 12:16:28] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:28] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:28] [WARNING] [main] system-info update failed; will try again in 10 seconds.
[2016-06-14 12:16:38] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:39] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:39] [WARNING] [main] system-info update failed; will try again in 10 seconds.

Daveatenergy

I tried a different password.  Now I get this.

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-worker -poller cluster_mgmt -v
[2016-06-14 12:33:39] [NORMAL ] WORKER STARTED [Version: 1.2.2] [Conf: netapp-harvest.conf] [Poller: cluster_mgmt]
[2016-06-14 12:33:39] [WARNING] Started in foreground mode; messages to STDERR are redirected to the logfile and are not visible on the console.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [19] is Section [global]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [20] in Section [global] has Key/Value pair [grafana_api_key]=[eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [21] in Section [global] has Key/Value pair [grafana_url]=[https://172.29.40.246]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [22] in Section [global] has Key/Value pair [grafana_dl_tag]=[]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [28] is Section [default]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [30] in Section [default] has Key/Value pair [graphite_enabled]=[1]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [31] in Section [default] has Key/Value pair [graphite_server]=[172.29.40.246]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [32] in Section [default] has Key/Value pair [graphite_port]=[2003]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [33] in Section [default] has Key/Value pair [graphite_proto]=[tcp]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [34] in Section [default] has Key/Value pair [normalized_xfer]=[mb
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [35] in Section [default] has Key/Value pair [normalized_time]=[mi
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [36] in Section [default] has Key/Value pair [graphite_root]=[defa
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [37] in Section [default] has Key/Value pair [graphite_meta_metric
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [40] in Section [default] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [41] in Section [default] has Key/Value pair [host_port]=[443]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [42] in Section [default] has Key/Value pair [host_enabled]=[1]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [43] in Section [default] has Key/Value pair [template]=[default]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [44] in Section [default] has Key/Value pair [data_update_freq]=[6
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [45] in Section [default] has Key/Value pair [ntap_autosupport]=[0
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [46] in Section [default] has Key/Value pair [latency_io_reqd]=[10
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [47] in Section [default] has Key/Value pair [auth_type]=[password
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [48] in Section [default] has Key/Value pair [username]=[opmadmin]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [49] in Section [default] has Key/Value pair [password]=[*********
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [60] is Section [cluster_mgmt]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [61] in Section [cluster_mgmt] has Key/Value pair [hostname]=[192.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [62] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [67] in Section [cluster_mgmt] has Key/Value pair [hostname]=[172.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [68] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [69] in Section [cluster_mgmt] has Key/Value pair [host_type]=[OCU
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [70] in Section [cluster_mgmt] has Key/Value pair [data_update_fre
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [71] in Section [cluster_mgmt] has Key/Value pair [normalized:_xfe
[2016-06-14 12:33:39] [NORMAL ] [main] Poller will monitor a [OCUM] at [172.29.40.60:443]
[2016-06-14 12:33:39] [NORMAL ] [main] Poller will use [password] authentication with username [opmadmin] and
[2016-06-14 12:33:39] [DEBUG ] [connect] Reverse hostname lookup successful. Using HTTP/1.1 for communicatio
[2016-06-14 12:33:39] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:33:39] [WARNING] [sysinfo] cluster-iter failed with reason: Unable to find API: cluster-iter

madden

Hi @Daveatenergy

 

Harvest can collect performance data from Clustered & 7-Mode Data ONTAP (FILER), and from OnCommand Unified Manager (OCUM).  The host_type variable sets if you have a FILER or OCUM.  From the log you are trying to collect data with host_type = OCUM.  Maybe try FILER?  

 

More is documented in the Harvest admin guide.

 

Regards

Chris

Daveatenergy

Tried changing it, still no data population.  

 

[2016-06-15 07:51:22] [NORMAL ] WORKER STARTED [Version: 1.2.2] [Conf: netapp-harvest.conf] [Poller: cluster_mgmt]
[2016-06-15 07:51:22] [WARNING] Started in foreground mode; messages to STDERR are redirected to the logfile and are not visible on the console.
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [19] is Section [global]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [20] in Section [global] has Key/Value pair [grafana_api_key]=[eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [21] in Section [global] has Key/Value pair [grafana_url]=[https://172.29.40.246]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [22] in Section [global] has Key/Value pair [grafana_dl_tag]=[]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [28] is Section [default]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [30] in Section [default] has Key/Value pair [graphite_enabled]=[1]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [31] in Section [default] has Key/Value pair [graphite_server]=[172.29.40.246]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [32] in Section [default] has Key/Value pair [graphite_port]=[2003]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [33] in Section [default] has Key/Value pair [graphite_proto]=[tcp]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [34] in Section [default] has Key/Value pair [normalized_xfer]=[mb_per_sec]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [35] in Section [default] has Key/Value pair [normalized_time]=[millisec]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [36] in Section [default] has Key/Value pair [graphite_root]=[default]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [37] in Section [default] has Key/Value pair [graphite_meta_metrics_root]=[default]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [40] in Section [default] has Key/Value pair [host_type]=[OCUM]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [41] in Section [default] has Key/Value pair [host_port]=[443]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [42] in Section [default] has Key/Value pair [host_enabled]=[1]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [43] in Section [default] has Key/Value pair [template]=[default]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [44] in Section [default] has Key/Value pair [data_update_freq]=[60]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [45] in Section [default] has Key/Value pair [ntap_autosupport]=[0]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [46] in Section [default] has Key/Value pair [latency_io_reqd]=[10]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [47] in Section [default] has Key/Value pair [auth_type]=[password]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [48] in Section [default] has Key/Value pair [username]=[opmadmin]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [49] in Section [default] has Key/Value pair [password]=[**********]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [60] is Section [cluster_mgmt]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [61] in Section [cluster_mgmt] has Key/Value pair [hostname]=[192.168.110.50]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [62] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [67] in Section [cluster_mgmt] has Key/Value pair [hostname]=[172.29.40.60]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [68] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [69] in Section [cluster_mgmt] has Key/Value pair [host_type]=[FILER]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [70] in Section [cluster_mgmt] has Key/Value pair [data_update_freq]=[900]
[2016-06-15 07:51:22] [DEBUG ] [conf] Line [71] in Section [cluster_mgmt] has Key/Value pair [normalized:_xfer]=[gb_per_sec]
[2016-06-15 07:51:22] [NORMAL ] [main] Poller will monitor a [FILER] at [172.29.40.60:443]
[2016-06-15 07:51:22] [NORMAL ] [main] Poller will use [password] authentication with username [opmadmin] and password [**********]
[2016-06-15 07:51:22] [DEBUG ] [connect] Reverse hostname lookup successful. Using HTTP/1.1 for communication.
[2016-06-15 07:51:22] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-15 07:51:22] [WARNING] [sysinfo] Update of system-info cache DOT Version failed with reason: Authorization failed
[2016-06-15 07:51:22] [WARNING] [main] system-info update failed; will try again in 10 seconds.

 

 

##
## Configuration file for NetApp Harvest
##
## Create a section header and then populate with key/value parameters
## for each system to monitor. Lines can be commented out by preceding them
## with a hash symbol ('#'). Values in all capitals should be replaced with
## your values, all other values can be left as-is to use defaults
##
## There are two reserved section names:
## [global] - Global key/value pairs for installation
## [default] - Any key/value pairs specified here will be the default
## value for a poller should it not be listed in a poller section.
##

##
## Global reserved section
##

[global]
grafana_api_key = eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=
grafana_url = https://172.29.40.246
grafana_dl_tag =

##
## Default reserved section
##

[default]
#====== Graphite server setup defaults ========================================
graphite_enabled = 1
graphite_server = 172.29.40.246
graphite_port = 2003
graphite_proto = tcp
normalized_xfer = mb_per_sec
normalized_time = millisec
graphite_root = default
graphite_meta_metrics_root = default

#====== Polled host setup defaults ============================================
host_type = OCUM
host_port = 443
host_enabled = 1
template = default
data_update_freq = 60
ntap_autosupport = 0
latency_io_reqd = 10
auth_type = password
username = opmadmin
password = *****
#ssl_cert = INSERT_PEM_FILE_NAME_HERE
#ssl_key = INSERT_KEY_FILE_NAME_HERE


##
## Monitored host examples - Use one section like the below for each monitored host
##

#====== 7DOT (node) or cDOT (cluster LIF) for performance info ================
#
[cluster_mgmt]
hostname = 192.168.110.50
site = OR

#====== OnCommand Unified Manager (OCUM) for cDOT capacity info ===============
#
#[scornopm1]
hostname = 172.29.40.60
site = OR
host_type = FILER
data_update_freq = 900
normalized:_xfer = gb_per_sec

Daveatenergy

Screenshots attached

madden

Hi,

 

Your netapp-harvest.conf file has a few inconsistencies, and if Harvest doesn't collect then nothing will show in Graphite/Grafana.

 

 First, start with this as your netapp-harvest.conf file:

 

 

##
## Configuration file for NetApp Harvest
##
## Create a section header and then populate with key/value parameters
## for each system to monitor.  Lines can be commented out by preceding them
## with a hash symbol ('#').  Values in all capitals should be replaced with
## your values, all other values can be left as-is to use defaults
##
## There are two reserved section names:
## [global]  - Global key/value pairs for installation
## [default] - Any key/value pairs specified here will be the default
##             value for a poller should it not be listed in a poller section.
##

##
## Global reserved section
##

[global]
grafana_api_key = eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=
grafana_url = https://172.29.40.246
grafana_dl_tag = 

##
## Default reserved section
##

[default]
#====== Graphite server setup defaults ======================================== 
graphite_enabled  = 1              
graphite_server   = 172.29.40.246
graphite_port     = 2003           
graphite_proto    = tcp            
normalized_xfer   = mb_per_sec     
normalized_time   = millisec       
graphite_root     =  default
graphite_meta_metrics_root  = default      

#====== Polled host setup defaults ============================================
host_type         = FILER          
host_port         = 443           
host_enabled      = 1             
template          = default       
data_update_freq  = 60            
ntap_autosupport  = 0             
latency_io_reqd   = 10            
auth_type         = password     
username          = opmadmin
password          = INSERT_PASSWORD_HERE      
ssl_cert          = INSERT_PEM_FILE_NAME_HERE            
ssl_key           = INSERT_KEY_FILE_NAME_HERE           
    

##
## Monitored host examples - Use one section like the below for each monitored host
##

#====== 7DOT (node) or cDOT (cluster LIF) for performance info ================
#
[INSERT_CLUSTER_OR_CONTROLLER_NAME_HERE]
hostname       = 192.168.110.50
site           = OR

#====== OnCommand Unified Manager (OCUM) for cDOT capacity info ===============
#
[scornopm1]
hostname          = 172.29.40.60
site              = OR
host_type         = OCUM                  
data_update_freq  = 900 
normalized_xfer   = gb_per_sec     

 

 

 

Next:

1) Replace INSERT_PASSWORD_HERE with your password

2) Replace INSERT_CLUSTER_OR_CONTROLLER_NAME_HERE with the name of your cluster (not the cluster lif, but the cluster name shown from 'cluster identity show')

 

Then, on both your cDOT cluster and your OCUM server (Unified Manager server, not Performance Manager server) you must have the opmadmin account created and password set. These accounts must have minimim privileges as defined in the Harvest user guide.  Because your OCUM servername has opm in it I am wondering if you also need to update the details to be for your OCUM server (and not OPM server).  If this is a misunderstanding, update the hostname and IP address to be your OCUM server.

 

Lastly start the pollers with

 

/opt/netapp-harvest/netapp-manager -start

 

Hope this helps.

 

 

 

 

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

 

 

Announcements
NetApp on Discord Image

We're on Discord, are you?

Live Chat, Watch Parties, and More!

Explore Banner

Meet Explore, NetApp’s digital sales platform

Engage digitally throughout the sales process, from product discovery to configuration, and handle all your post-purchase needs.

NetApp Insights to Action
I2A Banner
Public