Subscribe
Accepted Solution

netapp-harvest

HTTP Error

Internal Server Error

 

I can not get havest to connect to my datastore. 

 

 

Re: netapp-harvest

Hi @Daveatenergy

 

It sounds like your Graphite/Grafana server is not setup correctly.  Have you checked the troubleshooting steps in the Quick Start guide?

 

If you can check the logfiles (see the quick start guide) and share a more detailed error message maybe someone can help with how to fix.

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Re: netapp-harvest

I've been through both guides numerious times.  My import seems to work, however look at the attached screenshot.  

 

root@Netappharvest1:/home/ddurand# cat /var/log/grafana/grafana.log
2016/06/14 07:55:44 [I] Completed 172.29.40.40 admin "GET /logout HTTP/1.1" 302 Found 29 bytes in 1378us
2016/06/14 08:10:21 [I] Completed 172.29.40.40 admin "GET /api/dashboards/db/new-dashboard HTTP/1.1" 404 Not Found 33 bytes in 872us
2016/06/14 09:27:31 [I] Completed 172.29.40.40 admin "GET /api/datasources/5 HTTP/1.1" 404 Not Found 35 bytes in 1214us


root@Netappharvest1:/home/ddurand# cat /var/log/carbon/listener.log.2016_6_8
08/06/2016 07:25:51 :: MetricLineReceiver connection with 127.0.0.1:47796 established
08/06/2016 07:25:51 :: MetricLineReceiver connection with 127.0.0.1:47796 closed cleanly

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to http://172.29.40.246:443
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-detail-volume.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-windows-file-services.json] successfully
[OK ] Imported dashboard [db_netapp-detail-graphite-server.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-svm.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-node.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-harvest-poller.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-lif.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-volume.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-node.json] successfully

Re: netapp-harvest

Hi @Daveatenergy

 

 

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to http://172.29.40.246:443

 

Looks like a mismatch in red.  In netapp-harvest.conf try setting grafana_url parameter to use https.  You are not alone in this mismatch have already updated netapp-manager to be more helpful in case (it will be in the next release) and will also update the quickstart defaults to match the harvest user guide example syntax.

 

Hope that solves your issue!

 

Cheers,
Chris Madden

Storage Architect, NetApp EMEA (and author of Harvest)

Blog: It all begins with data

 

If this post resolved your issue, please help others by selecting ACCEPT AS SOLUTION or adding a KUDO or both!

Re: netapp-harvest

Okay, I changed that up and received this:

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to https://172.29.40.246
[ERROR ] Failed to import dashboard [db_netapp-dashboard-7-mode-group.json] due to error: 401 Unauthorized
[ERROR ] -Response was :{"message":"Invalid API key"}

Re: netapp-harvest

Hi @Daveatenergy

 

 

My guess is something went wrong with your copy/paste of the API key from the Grafana Web UI and pasted as the value for the grafana_api_key variable in the netapp-harvest.conf file.  I would create a new API key in Grafana and apply it again being sure the entire string is copy/pasted. 

 

Hope this helps.

 

Cheers,
Chris

Re: netapp-harvest

I now have imported dashboards.  However, they are not populated with anything.  

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -import
[OK ] Will import dashboards to https://172.29.40.246
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-disk-and-cache-layers.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-detail-volume.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-windows-file-services.json] successfully
[OK ] Imported dashboard [db_netapp-detail-graphite-server.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-svm.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-node.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-cluster-group.json] successfully
[OK ] Imported dashboard [db_netapp-detail-harvest-poller.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-lif.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-volume.json] successfully
[OK ] Imported dashboard [db_netapp-detail-7-mode-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-lun.json] successfully
[OK ] Imported dashboard [db_netapp-detail-network-port.json] successfully
[OK ] Imported dashboard [db_netapp-dashboard-7-mode-node.json] successfully
root@Netappharvest1:/home/ddurand#

Re: netapp-harvest

But I am seeing this.

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -stop
STATUS POLLER SITE
############### #################### ##################
[STOPPED] cluster_mgmt OR
root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-manager -start
STATUS POLLER SITE
############### #################### ##################
[STARTED] cluster_mgmt OR
root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-worker -poller cluster_mgmt -v
[2016-06-14 12:16:18] [NORMAL ] WORKER STARTED [Version: 1.2.2] [Conf: netapp-harvest.conf] [Poller: cluster_mgmt]
[2016-06-14 12:16:18] [WARNING] Started in foreground mode; messages to STDERR are redirected to the logfile and are not visible on the console.
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [19] is Section [global]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [20] in Section [global] has Key/Value pair [grafana_api_key]=[eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [21] in Section [global] has Key/Value pair [grafana_url]=[https://172.29.40.246]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [22] in Section [global] has Key/Value pair [grafana_dl_tag]=[]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [28] is Section [default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [30] in Section [default] has Key/Value pair [graphite_enabled]=[1]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [31] in Section [default] has Key/Value pair [graphite_server]=[172.29.40.246]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [32] in Section [default] has Key/Value pair [graphite_port]=[2003]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [33] in Section [default] has Key/Value pair [graphite_proto]=[tcp]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [34] in Section [default] has Key/Value pair [normalized_xfer]=[mb_per_sec]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [35] in Section [default] has Key/Value pair [normalized_time]=[millisec]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [36] in Section [default] has Key/Value pair [graphite_root]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [37] in Section [default] has Key/Value pair [graphite_meta_metrics_root]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [40] in Section [default] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [41] in Section [default] has Key/Value pair [host_port]=[443]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [42] in Section [default] has Key/Value pair [host_enabled]=[1]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [43] in Section [default] has Key/Value pair [template]=[default]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [44] in Section [default] has Key/Value pair [data_update_freq]=[60]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [45] in Section [default] has Key/Value pair [ntap_autosupport]=[0]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [46] in Section [default] has Key/Value pair [latency_io_reqd]=[10]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [47] in Section [default] has Key/Value pair [auth_type]=[password]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [48] in Section [default] has Key/Value pair [username]=[admin]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [49] in Section [default] has Key/Value pair [password]=[**********]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [60] is Section [cluster_mgmt]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [61] in Section [cluster_mgmt] has Key/Value pair [hostname]=[192.168.110.50]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [62] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [67] in Section [cluster_mgmt] has Key/Value pair [hostname]=[172.29.40.60]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [68] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [69] in Section [cluster_mgmt] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [70] in Section [cluster_mgmt] has Key/Value pair [data_update_freq]=[900]
[2016-06-14 12:16:18] [DEBUG ] [conf] Line [71] in Section [cluster_mgmt] has Key/Value pair [normalized:_xfer]=[gb_per_sec]
[2016-06-14 12:16:18] [NORMAL ] [main] Poller will monitor a [OCUM] at [172.29.40.60:443]
[2016-06-14 12:16:18] [NORMAL ] [main] Poller will use [password] authentication with username [admin] and password [**********]
[2016-06-14 12:16:18] [DEBUG ] [connect] Reverse hostname lookup successful. Using HTTP/1.1 for communication.
[2016-06-14 12:16:18] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:18] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:18] [WARNING] [main] system-info update failed; will try again in 10 seconds.
[2016-06-14 12:16:28] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:28] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:28] [WARNING] [main] system-info update failed; will try again in 10 seconds.
[2016-06-14 12:16:38] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:16:39] [WARNING] [sysinfo] system-about API failed with reason: Authorization failed
[2016-06-14 12:16:39] [WARNING] [main] system-info update failed; will try again in 10 seconds.

Re: netapp-harvest

I tried a different password.  Now I get this.

 

root@Netappharvest1:/home/ddurand# /opt/netapp-harvest/netapp-worker -poller cluster_mgmt -v
[2016-06-14 12:33:39] [NORMAL ] WORKER STARTED [Version: 1.2.2] [Conf: netapp-harvest.conf] [Poller: cluster_mgmt]
[2016-06-14 12:33:39] [WARNING] Started in foreground mode; messages to STDERR are redirected to the logfile and are not visible on the console.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [19] is Section [global]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [20] in Section [global] has Key/Value pair [grafana_api_key]=[eyJrIjoiNURNMGVOdU1Iem00dXlZSDRjd2dOQXVQVlVuZXRWUFQiLCJuIjoiR3JhcGhpdGUiLCJpZCI6MX0=]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [21] in Section [global] has Key/Value pair [grafana_url]=[https://172.29.40.246]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [22] in Section [global] has Key/Value pair [grafana_dl_tag]=[]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [28] is Section [default]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [30] in Section [default] has Key/Value pair [graphite_enabled]=[1]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [31] in Section [default] has Key/Value pair [graphite_server]=[172.29.40.246]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [32] in Section [default] has Key/Value pair [graphite_port]=[2003]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [33] in Section [default] has Key/Value pair [graphite_proto]=[tcp]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [34] in Section [default] has Key/Value pair [normalized_xfer]=[mb
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [35] in Section [default] has Key/Value pair [normalized_time]=[mi
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [36] in Section [default] has Key/Value pair [graphite_root]=[defa
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [37] in Section [default] has Key/Value pair [graphite_meta_metric
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [40] in Section [default] has Key/Value pair [host_type]=[OCUM]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [41] in Section [default] has Key/Value pair [host_port]=[443]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [42] in Section [default] has Key/Value pair [host_enabled]=[1]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [43] in Section [default] has Key/Value pair [template]=[default]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [44] in Section [default] has Key/Value pair [data_update_freq]=[6
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [45] in Section [default] has Key/Value pair [ntap_autosupport]=[0
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [46] in Section [default] has Key/Value pair [latency_io_reqd]=[10
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [47] in Section [default] has Key/Value pair [auth_type]=[password
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [48] in Section [default] has Key/Value pair [username]=[opmadmin]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [49] in Section [default] has Key/Value pair [password]=[*********
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [60] is Section [cluster_mgmt]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [61] in Section [cluster_mgmt] has Key/Value pair [hostname]=[192.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [62] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [67] in Section [cluster_mgmt] has Key/Value pair [hostname]=[172.
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [68] in Section [cluster_mgmt] has Key/Value pair [site]=[OR]
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [69] in Section [cluster_mgmt] has Key/Value pair [host_type]=[OCU
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [70] in Section [cluster_mgmt] has Key/Value pair [data_update_fre
[2016-06-14 12:33:39] [DEBUG ] [conf] Line [71] in Section [cluster_mgmt] has Key/Value pair [normalized:_xfe
[2016-06-14 12:33:39] [NORMAL ] [main] Poller will monitor a [OCUM] at [172.29.40.60:443]
[2016-06-14 12:33:39] [NORMAL ] [main] Poller will use [password] authentication with username [opmadmin] and
[2016-06-14 12:33:39] [DEBUG ] [connect] Reverse hostname lookup successful. Using HTTP/1.1 for communicatio
[2016-06-14 12:33:39] [DEBUG ] [sysinfo] Updating system-info cache
[2016-06-14 12:33:39] [WARNING] [sysinfo] cluster-iter failed with reason: Unable to find API: cluster-iter

Re: netapp-harvest

Hi @Daveatenergy

 

Harvest can collect performance data from Clustered & 7-Mode Data ONTAP (FILER), and from OnCommand Unified Manager (OCUM).  The host_type variable sets if you have a FILER or OCUM.  From the log you are trying to collect data with host_type = OCUM.  Maybe try FILER?  

 

More is documented in the Harvest admin guide.

 

Regards

Chris