topic Re: Harvest Snappmirror Replications dashboard datasource failed in Active IQ Unified Manager Discussions

Harvest Snappmirror Replications dashboard datasource failed

PhilipStilling — Wed, 16 Oct 2019 08:30:55 GMT

Hello Community,

actually i am running a Harvest with the following versions:

NAbox 2.5 (2018-12-16).
NMSDK 9.6.
Harvest 1.6.

I want to use the Snapmirror Replications Dashboard, but the Grafana can't find the Datasource:

Datasource named ${DS_GRAPHITE} was not found

Does anybody have a clue how to solve this issue? I can't find the mentioned DataSource in Grphite as well.

Greetings Philip

Re: Harvest Snappmirror Replications dashboard datasource failed

yannb — Thu, 17 Oct 2019 15:10:33 GMT

@vachagan_gratian 🙂

Yes that's a known bug, the workaround is to edit the JSON for the dashboard, in Grafana, and replace ${DS_GRAPHITE} by "default", I'm writing this from memory.

Be aware that in itself, this is not enough, you also need to enable the snapmirror plugin in harvest configuration (it's provided in standard distribution)

[EDIT]

Snapmirror extension is available in the extensions directory and enabled in the "template" directive of the config file, see IAG chapter 12

[my_controller]
hostname = 10.77.77.4
group = DEV
username = my_username
password = my_password
template = default, extensions.conf

Re: Harvest Snappmirror Replications dashboard datasource failed

PhilipStilling — Thu, 17 Oct 2019 06:26:54 GMT

@yannb Thank you for your reply.

@yannb wrote:

Be aware that in itself, this is not enough, you also need to enable the snapmirror plugin in harvest configuration (it's provided in standard distribution)

Sorry maybe i have tomatos on my eyes but i can't find the mentioned plugin. Could you please send me a link to the mentioned document?

Greetings Philip

Re: Harvest Snappmirror Replications dashboard datasource failed

yannb — Thu, 17 Oct 2019 08:01:33 GMT

If you're using 1.6, it should be described in the Installation and Admin guide, let me know if you can't find it I'll dig that out for you.

Re: Harvest Snappmirror Replications dashboard datasource failed

MartINC — Thu, 17 Oct 2019 15:30:17 GMT

There's a typo in the doc, you must write "extension" without an "s";

template = default,extension.conf

Re: Harvest Snappmirror Replications dashboard datasource failed

jfc916 — Thu, 17 Oct 2019 17:08:08 GMT

did you get this error?

[2019-09-20 12:26:00,736] [ERROR] [load_prereqs] Failed to import NaServer: No module named NaServer

cant figure out a solution or this.

Re: Harvest Snappmirror Replications dashboard datasource failed

MartINC — Thu, 17 Oct 2019 17:15:50 GMT

yes I do have the same error. Another user reported the issue in the following discution:

https://community.netapp.com/t5/Data-Infrastructure-Management-Software-Discussions/NetApp-Harvest-1-6-is-out/td-p/150671

I'm still waiting for a solution.

Re: Harvest Snappmirror Replications dashboard datasource failed

jfc916 — Thu, 17 Oct 2019 17:18:19 GMT

thanks, guess i will wait in line.

Re: Harvest Snappmirror Replications dashboard datasource failed

jfc916 — Thu, 17 Oct 2019 18:05:46 GMT

so i got beyond this issue, i downloaded sdk96 and copied the files

DfmErrno.py
NaElement.py
NaElement.pyc
NaErrno.py
NaServer.py
NaServer.pyc

to the lib dir

but know i get the following error.

[2019-10-17 14:03:01,160] [ERROR] [poll_snapmirrors] ZAPI request failed: Insufficient privileges: user 'netapp-harvest' does not have read access to this resource

Re: Harvest Snappmirror Replications dashboard datasource failed

MartINC — Thu, 17 Oct 2019 18:38:29 GMT

.py ? Oh interessting. I only have .pm files in that folder (/opt/netapp-harvest/lib).

Unziping the SDK extract .pm files not .py, is that right ?. Example from doc:

unzip -j netapp-manageability-sdk-9.6.zip netapp-manageability-sdk-9.6/lib/perl/NetApp/* -d /opt/netapp-harvest/lib
Archive: netapp-manageability-sdk-9.6.zip
inflating: /opt/netapp-harvest/lib/DfmErrno.pm
inflating: /opt/netapp-harvest/lib/NaElement.pm
inflating: /opt/netapp-harvest/lib/NaErrno.pm
inflating: /opt/netapp-harvest/lib/NaServer.pm

Re: Harvest Snappmirror Replications dashboard datasource failed

jfc916 — Thu, 17 Oct 2019 18:46:44 GMT

yeah, i just copied the py files to the /opt/netapp-harvest/lib and the error went away, the next error I got was an authorization error, so i elevated the harvest user to admin, and the files are gettting generated. It seems to be working.

Re: Harvest Snappmirror Replications dashboard datasource failed

yannb — Thu, 17 Oct 2019 18:49:07 GMT

Yes that part is a bit confusing. You need the perl sdk for harvest itself, but the extension being written in python, you also need the python SDK, which, this time, must be present in the python/ directory without the NetApp parent directory.

Re: Harvest Snappmirror Replications dashboard datasource failed

MartINC — Thu, 17 Oct 2019 19:45:10 GMT

I'm also getting farther after uploading the .py files from the SDK to the /lib folder.

I'm using auth_type = ssl_cert. Data collection is working perfectly but the snapmirror extension complains about ssl certificate:

[ERROR] [poll_snapmirrors] ZAPI request failed: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)

Re: Harvest Snappmirror Replications dashboard datasource failed

yannb — Thu, 17 Oct 2019 21:04:30 GMT

Extensions in Harvest are quite new, and are provided as examples, with the current distribution, meaning they are to be taken "as-is" and might need some improvement (which will happen over time I'm sure).

The only supported authentication method is LOGIN, you can certainly implement certificate authentication in the code, and feel free to share your changes here 🙂

Re: Harvest Snappmirror Replications dashboard datasource failed

vachagan_gratian — Wed, 23 Oct 2019 10:52:55 GMT

Hi @MartINC, the snapmirror extension only supports authentication by password, but I think I can adapt it to support certificate authentication as well. Let me know if you need that.

Re: Harvest Snappmirror Replications dashboard datasource failed

MartINC — Wed, 23 Oct 2019 12:05:23 GMT

Hi Gratian,

Yes I believe that would be a nice feature to add for security purpose.

Thanks!

Martin.

Re: Harvest Snappmirror Replications dashboard datasource failed

johannes_mitterer — Sat, 25 Jan 2020 23:33:32 GMT

@jfc916 wrote:

yeah, i just copied the py files to the /opt/netapp-harvest/lib and the error went away, the next error I got was an authorization error, so i elevated the harvest user to admin, and the files are gettting generated. It seems to be working.

You don't have to give the harvest user full admin permissions. It is just necessary to give access to the "snapmirror show":

security login role create -role netapp-harvest-role -access readonly -cmddirname "snapmirror show"

@vachagan_gratian: maybe this should be added to the "Harvest Administration Guide" Topic 5.2.2