The transition to NetApp MS Azure AD B2C is complete. If you missed the pre-registration, you will be invited to reigister at next log in.
Please note that access to your NetApp data may take up to 1 hour.
To learn more, read the FAQ and watch the video.
Need assistance? Complete this form and select “Registration Issue” as the Feedback Category.

Active IQ Unified Manager Discussions

NetApp Harvest 1.6 snapmirror and NFS-connections dashboard

Mytch

The NFS-connections and snapmirror dashboard is giving me this error.

 

Templating init failed
Datasource named ${DS_GRAPHITE} was not found
24 REPLIES 24

Cbrown

I'm also hitting this issue with NFS Connections and Snapmirror Replications. 

 

Any updates? 

 

Chris 

DANTAYLOR80

Same issue.

mmorshed11

Datasource named ${DS_GRAPHITE} was not found

 

same issue any suggestion ?

 

 

 

 

Hi,

 

You can either run the updater here and use the new Grafana dashboards or follow my instructions here to fix the dashboard manually. Hope that helps!

hey - just to add to my comment below the manual updated also didn't fix this issue. 

Hi, I would recommend to use the dashboards from the updater package. Just first run the updater, then import the db_netapp-detail-snapmirror.json dashboard from the folder /opt/netapp-harvest/grafana/ to your Grafana webgui.

Thanks, @vachagan_gratian I ran the update package.

 

Got one issue #

[WARNING] [connect_zapi] Failed to connect to NaServer: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)

 

Host # REHL Linux Server release 7.7 (Maipo)

Python #  2.7.5

Ontap 9.3P15

 

To Resolve the issue #  had to enter following line  snapmirror_replications.py

import ssl
ssl._create_default_https_context = ssl._create_unverified_context

 

Possible Bugs #

1.  Log file name "_replicatons.log "

2. With Ontap 8.3.2P12  dashboard not populating data - [ERROR] [poll_meters] ZAPI request failed: For smc_em object, no instances were found to match the given query. 

3.  Volume capacity dashboard not  displaying any data

4. NFS Connection dashboard not displaying any data

 

mmorshed11

Make sure in  netapp-harvest.conf   template = default,extension.conf  (not extensions.conf)

and in JSON file

all 5 entries

"datasource": null,

 

{
"aliasColors": {},
"bars": false,
"dashLength": 10,
"dashes": false,
"datasource": null,
"fill": 1,
"fillGradient": 0,
"gridPos": {
"h": 9,
"w": 23,
"x": 0,
"y": 0
},

 

Restart poller  and checked the log

 

[root@XXXXXX log]# /opt/netapp-harvest/netapp-manager -restart -v
[OK ] Line [29] is Section [global]
[OK ] Line [30] in Section [global] has Key/Value pair [grafana_api_key]=[**********]
[OK ] Line [31] in Section [global] has Key/Value pair [grafana_url]=[https://X.X.X.X]
[OK ] Line [36] is Section [default]
[OK ] Line [37] in Section [default] has Key/Value pair [graphite_server]=[X.X.X.X]
[OK ] Line [38] in Section [default] has Key/Value pair [username]=[netapp-harvest]
[OK ] Line [39] in Section [default] has Key/Value pair [password]=[**********]
[OK ] Line [42] in Section [default] has Key/Value pair [send_autosupport_stats]=[1]
[OK ] Line [68] is Section [CLUSTERNAME]
[OK ] Line [69] in Section [CLUSTERNAME]] has Key/Value pair [hostname]=[X.X.X.X]
[OK ] Line [70] in Section [CLUSTERNAME]] has Key/Value pair [group]=[XXX_cDot]
[OK ] Line [71] in Section [CLUSTERNAME]] has Key/Value pair [username]=[netapp-harvest]
[OK ] Line [72] in Section [CLUSTERNAME]] has Key/Value pair [password]=[**********]
[OK ] Line [73] in Section [CLUSTERNAME] has Key/Value pair [template]=[default,extension.conf]

 

cat /opt/netapp-harvest/log/FILERNAME_netapp-harvest_netapp-harvest_snapmirror_replications.log

 

Grafana v6.5.3  Harvest 1.6

 

Thanks, @vachagan_gratian   I was able to sort out the issue by following steps

1.  Copy python module

Unzip netapp-manageability-sdk-9.7.zip         (/tmp/netapp-manageability-sdk-9.7/lib/python/NetApp)
   Copy  these files NaElement.py NaErrno.py NaServer.py to  /opt/netapp-harvest/lib

 

2.  Update poller

# csgxxxxxxxx
[csgxxxxxx]
hostname = XXX.XX.XX.XX
group = XXX_cDot
template = default,extension.conf

 

3. Ignore SSL validation  # due to error ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)

vi /opt/netapp-harvest/extension/snapmirror_replications.py

 

Add following red line after import  logging &  before def main();

import logging

import ssl

try:
_create_unverified_https_context = ssl._create_unverified_context
except AttributeError:
# Legacy Python that doesn't verify HTTPS certificates by default
pass
else:
# Handle target environment that doesn't support HTTPS verification
ssl._create_default_https_context = _create_unverified_https_context


def main():

 

4. Add  privileges  # ZAPI request failed: Insufficient privileges: user 'netapp-harvest' does not have read access to this resource

 

Add snapmirror show command  to role

security login role create -role netapp-harvest-role -access readonly -cmddirname "snapmirror show"

 

5. Change all "datasource": null, from Snapmirror Replication Settings - JSON Model

 

${DS_GRAPHITE} to "datasource": null

Then Refresh Browser

Grafana.jpg

@mmorshed11 thanks a lot for this info! I forgot to mention that you have to extend the ONTAP user privileges (the bad habit of always testing with an admin user...).

 

The reason you only see destination snapmirrors in your Grafana is a bug in the extension. I recommend getting the recent updater to fix this (this will create a backup and overwrite your modified extension).

 

As for 3, I am surprised you go this error, what Python version was running the process?


@vachagan_gratian wrote:

The reason you only see destination snapmirrors in your Grafana is a bug in the extension. I recommend getting the recent updater to fix this (this will create a backup and overwrite your modified extension).

I've run the updater on a new installation and can confirm that while the dashboard templating issues are resolved, I'm still only seeing data on the destination relationships per node panel for the snapmirror replications dashboard.  Is there any way to confirm that the update applied correctly?  Running it again hasn't had any impact.

 

So far all that I'm seeing in the logs are the following entries repeated in each logfile:

cluster1

[ERROR] [poll_nodes] ZAPI request failed: For volume object, no instances were found to match the given query.

 

cluster2

[WARNING] [poll_snapmirrors] Destination relationship with no node or volume. Skipping
[WARNING] [poll_snapmirrors] Source relationship with no volume. Skipping
[ERROR] [poll_nodes] ZAPI request failed: For volume object, no instances were found to match the given query.

 

cluster3

[INFO] [poll_snapmirrors] No Snapmirror replications on this cluster, stopping session

 

i currently have the following snapmirrors:

  • 1 from cluster 2 to cluster 1
  • 2 from cluster 3 to cluster 1
  • 11 from clster 1 to cluster 2

 

israelmmi

Excuse me for the nubi question:

1. Do i need to configure a seperate cron job for this script, or will the overall script which deals with the other collection take care of this?

2. Regarding params for this script:

 when running it I get at the end "[2020-05-24 08:11:20,762] [DEBUG] [send_to_graphite] Skipping send: no graphite root defined". Do I  need to input manually the graphite, user,pass info? Or will it inherit the info?

Hi,

 

1. No need for that, the extensions are started and managed by Harvest 1.6. You only need to check the specific dependencies of each extension itself. (E.g. in case of the SnapMirrors extension, the Python package of NetApp SDK is required).

 

2. You get the message because you started the extension in foreground. When it's normally started in the background, all required parameters are passed on by Harvest 1.6 as environment variables.

 

Let me know if you have more questions!

 

Vachagan

Can we get an updated link to download the extension files?

FRAZERBRADBURN

Going to try the above fix but the initial fix provided certainly doesn't work. 

 

On saving the dashboard you get Datasource named null was not found when you make the initial fix. 

 

 

Hi,

 

I believe that the link on how to manually fix the dashboard is wrong. Can you please advise if this is the case and update it with the correct one.

 

Thanks.

vachagan_gratian

This might be a Grafana backward compabilitiy issue of dashboard. What version do you have? If it's older than 5, I think updating Grafana might solve this for you.

Mytch

I will look at that.  I do get these error on the extension scripts...not sure if that impacts the dashboard.  I would expect not as it should show an empty one at any rate.

 

snapmirror

[2019-11-08 11:24:00,511] [ERROR] [poll_snapmirrors] ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)
[2019-11-08 11:25:01,396] [ERROR] [poll_snapmirrors] ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)
[2019-11-08 11:26:00,793] [ERROR] [poll_snapmirrors] ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)
[2019-11-08 11:27:02,743] [ERROR] [poll_snapmirrors] ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)

 

i resolved the nfs-connections one.

[2019-11-08 10:30:41] [WARNING] [sshpass] not installed, can't run package [nfs-connections.sh], exiting
[2019-11-08 10:46:01] [WARNING] [sshpass] not installed, can't run package [nfs-connections.sh], exiting
[2019-11-08 11:01:01] [WARNING] [sshpass] not installed, can't run package [nfs-connections.sh], exiting
[2019-11-08 11:15:59] [WARNING] [sshpass] not installed, can't run package [nfs-connections.sh], exiting
[2019-11-08 11:31:03] [DEBUG ] Session started
[2019-11-08 11:31:03] [DEBUG ] Session ended

vachagan_gratian

The Dashboard import error is unrelated to those ones.

 

Re: snapmirror

Are you using SSL authentication? Unfortunately that's not supported in the Extention Manager (although we are planning to support that sometime soon). For now you can use the extension packages user/password authentication.

 

Re: nfs-connections

Seems like the dependency sshpass is missing. (`apt install sshpass` will install it on a Debian-like system). If you already installed it, it might be the same authentication issue as above.

Mytch

As we jump topics......

 

I ugraded to Grafana 6.4.4 and I still get the same error.  Like the variable DS_GRAPHITE is not confgiured somewhere?

 

I am not using SSL authentication for any part of the Harvest environment.  Seems like a python thing

 

#====== Polled host setup defaults ============================================
host_type = FILER
host_port = 443
host_enabled = 1
template = default
data_update_freq = 60
ntap_autosupport = 0
latency_io_reqd = 10
auth_type = password

Announcements
NetApp on Discord Image

We're on Discord, are you?

Live Chat, Watch Parties, and More!

Explore Banner

Meet Explore, NetApp’s digital sales platform

Engage digitally throughout the sales process, from product discovery to configuration, and handle all your post-purchase needs.

NetApp Insights to Action
I2A Banner
Public