SnapCreator overwritting snapmirror.conf, making changes to volume options?

[ntitlow01]

I am using SnapCreator in a lab environment to perform snapmirror updates. SnapCreator is run out of cron on two-minute intervals. Once last night and once today, the snapmirror.conf on the destination was overwritten and volume options changed. Speaking with NetApp support, SnapCreator could be the culprit. Has anyone else seen this behavior?

Environment:

- Both source and destination arrays are running ONTAP 7.3.3P5

- SC 3.2 and DFM 4.0 (installed on same server)

List of changes from yesterday:

- SnapCreator installed, jobs configured and run

- Array added to DFM (version 4.0)

- Various tests with Protection Manager both with SnapCreator integration and without. (the data set and policy was deleted last night before the first wipe of snapmirror.conf).

Thanks in advance for any thoughts.

-nathan

Here some auditlog snippets from today:

Prior to problem - connections from SC/DFM server:

Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_09:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.0</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_08:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.1</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_02:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.2</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_00:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.3</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_03:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.4</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:15:02 PDT [lvlabfiler01a: api_mpool_01:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><file-read-file><path>/vol/vol0/etc/log/snapmirror.5</path><offset>0</offset><length>1048576</length></file-read-file></netapp>
Wed Oct 27 13:16:33 PDT [lvlabfiler01a: api_mpool_06:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><system-cli><priv>advanced</priv><args><arg>registry</arg><arg>walk</arg><arg>status.if</arg></args></system-cli></netapp>

The Problem:

Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: FILE: DELETE: /etc/snapmirror.conf#1:csrfiler01-a:nathan_iscsi_test    lvlabfiler01a:sm_nathan_iscsi_test restart=never - - - -
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: FILE: DELETE: /etc/snapmirror.conf#2:csrfiler01-a:nathan_sm_test2    lvlabfiler01a:sm_nathan_sm_test2   restart=never - - - -
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: FILE: NEW: /etc/snapmirror.conf#1:#Regenerated by registry Wed Oct 27 20:11:47 GMT 2010
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.convert_ucode:on
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.create_ucode:on
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.extent:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.lang:en_US.UTF-8
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.maxdirsize:41861
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.maxfiles:1182916
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.minra:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.no_atime_update:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.no_i2p:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.nosnap:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.nosnapdir:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.nvfail:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.quotas:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.read_realloc:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.schedsnapname:ordinal
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_iscsi_test.snapmirrored:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.convert_ucode:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.create_ucode:on
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.extent:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.lang:en_US.UTF-8
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.maxdirsize:41861
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.maxfiles:311280
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.minra:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.no_atime_update:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.no_i2p:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.nosnap:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.nosnapdir:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.nvfail:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.quotas:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.read_realloc:off
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.schedsnapname:ordinal
Wed Oct 27 13:30:38 PDT [lvlabfiler01a: registry_control:debug]: root: NEW:options.vols.sm_nathan_sm_test2.snapmirrored:off

Post Problem - connections from SC/DFM server:

Wed Oct 27 13:34:45 PDT [lvlabfiler01a: api_mpool_01:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><system-cli><priv>advanced</priv><args><arg>registry</arg><arg>walk</arg><arg>status.if</arg></args></system-cli></netapp>
Wed Oct 27 13:36:26 PDT [lvlabfiler01a: api_mpool_09:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><system-cli><args><arg>vol</arg><arg>lang</arg></args></system-cli></netapp>
Wed Oct 27 13:36:26 PDT [lvlabfiler01a: api_mpool_09:debug]: root@[10.159.2.45]:API:http in:<?xml version='1.0' encoding='utf-8' ?> <!DOCTYPE netapp SYSTEM 'file:/etc/netapp_filer.dtd'> <netapp xmlns="http://www.netapp.com/filer/admin" version="1.0"><system-available-replication-transfers/></netapp>

[lgreg]

I cant imagine that snapcreator edits/changes/overwrites the snapmirror.conf

file. Have used it a lot and have yet to experience that scenario.. Yet, the

integration to Protection Manager may be the variable in the mix

Greg Loughmiller

Global Enterprise Applications Solution Lead, NCIE-SAN

Enterprise Applications Solution Team

NetApp

678.982.6099 Mobile Phone

lgreg@netapp.com

From: ntitlow01 <xdl-communities@netapp.com>

Reply-To: "netapp-dev@sgaur.hosted.jivesoftware.com"

<netapp-dev@sgaur.hosted.jivesoftware.com>

Date: Wed, 27 Oct 2010 14:56:21 -0700

To: gregory loughmiller <lgreg@netapp.com>

Subject: "SnapCreator overwritting snapmirror.conf, making changes to volume

options?" [NetApp Community > Products & Solutions > Databases & Enterprise

Apps > SnapCreator]

NetApp Community <http://communities.netapp.com/index.jspa>

SnapCreator overwritting snapmirror.conf, making changes to volume options?

created by ntitlow01 <http://communities.netapp.com/people/ntitlow01> in

SnapCreator - View the full discussion

<http://communities.netapp.com/message/42213#42213>

I am using SnapCreator in a lab environment to perform snapmirror updates.

SnapCreator is run out of cron on two-minute intervals. Once last night and

once today, the snapmirror.conf on the destination was overwritten and

volume options changed. Speaking with NetApp support, SnapCreator could be

the culprit. Has anyone else seen this behavior? Environment:- Both source

and destination arrays are running ONTAP 7.3.3P5- SC 3.2 and DFM 4.0

(installed on same server) List of changes from yesterday:- SnapCreator

installed, jobs configured and run- Array added to DFM (version 4.0)-

Various tests with Protection Manager both with SnapCreator integration and

without. (the data set and policy was deleted last night before the first

wipe of snapmirror.conf). Thanks in advance for any thoughts. -nathan  Here

some auditlog snippets from today: Prior to problem - connections from

SC/DFM server:Wed Oct 27 13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:15:02 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27

13:16:33 PDT :

root@[10.159.2.45]:API:http in: The Problem:Wed

Oct 27 13:30:38 PDT : FILE: DELETE:

/etc/snapmirror.conf#1:csrfiler01-a:nathan_iscsi_test   

lvlabfiler01a:sm_nathan_iscsi_test restart=never - - - -Wed Oct 27 13:30:38

PDT : FILE: DELETE:

/etc/snapmirror.conf#2:csrfiler01-a:nathan_sm_test2   

lvlabfiler01a:sm_nathan_sm_test2   restart=never - - - -Wed Oct 27 13:30:38

PDT : FILE: NEW:

/etc/snapmirror.conf#1:#Regenerated by registry Wed Oct 27 20:11:47 GMT

2010Wed Oct 27 13:30:38 PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.convert_ucode:onWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.create_ucode:onWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.extent:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.lang:en_US.UTF-8Wed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.maxdirsize:41861Wed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.maxfiles:1182916Wed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.minra:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.no_atime_update:offWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.no_i2p:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.nosnap:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.nosnapdir:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.nvfail:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.quotas:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_iscsi_test.read_realloc:offWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.schedsnapname:ordinalWed Oct 27

13:30:38 PDT : root:

NEW:options.vols.sm_nathan_iscsi_test.snapmirrored:offWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_sm_test2.convert_ucode:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.create_ucode:onWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.extent:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.lang:en_US.UTF-8Wed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.maxdirsize:41861Wed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.maxfiles:311280Wed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.minra:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.no_atime_update:offWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_sm_test2.no_i2p:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.nosnap:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.nosnapdir:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.nvfail:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.quotas:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.read_realloc:offWed Oct 27 13:30:38 PDT

: root:

NEW:options.vols.sm_nathan_sm_test2.schedsnapname:ordinalWed Oct 27 13:30:38

PDT : root:

NEW:options.vols.sm_nathan_sm_test2.snapmirrored:off Post Problem -

connections from SC/DFM server:Wed Oct 27 13:34:45 PDT [lvlabfiler01a:

api_mpool_01:debug]: root@[10.159.2.45]:API:http in:Wed Oct 27

13:36:26 PDT :

root@[10.159.2.45]:API:http in:Wed Oct 27 13:36:26 PDT :

root@[10.159.2.45]:API:http in: Start a

new discussion in SnapCreator at NetApp Community

<http://communities.netapp.com/choose-container!input.jspa?contentType=1&con

tainerType=14&container=2481

[ktenzer]

Hi Nathan,

SnapCreator does not touch the snapmirror.conf file. It does not create or manage snapmirror relationships. We simply take snapshots and do the update. There isn't anything I can think of that could cause this from SnapCreator. You can run with --debug option which produces the ZAPI calls we send and look in the logs, maybe even send those ZAPI calls to NGS to show them SnapCreator is not the problem.

If you are using qtree snapmirror then if somehow the snapshot which holds the relationship gets deleted then the relationship itself would be delete and you would need to do a re-sync or re-initialize. SnapCreator checks snapshot dependencies however and will not delete a snapshot with a dependency. This could however be done through cli or using the --action delete option which allows you to delete regardless of dependency. But assuming you didnt manually delete relationship with or without snapcreator it should in no way be affected. Of course this has nothing to do what snapmirror.conf file.

I know this doesn't answer your question as to what is causing the problem but hopefully this helps narrow things down.

Regards,

Keith