clonevol action failed on NTAP_CLONE_IGROUP_MAP

mauro · ‎2013-10-10

There are 7 volume (1 lun a volume) on fas6280a, snapmirrored on fas6280b , that must be cloned to a test oracle machine (from secondary fas6280b...).

Backup is ok, snapmirror is ok ,first clone and lun map is ok, at second clone there is a strange behaviour..

from config file:

NTAP_CLONE_IGROUP_MAP=fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_bin/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_ctl/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_data1/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_data2/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_temp/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_redo/ig_as_lnx150_as_lnx151;fas6280b:sv_as_lnx150_as_lnx151_oraprod6_dg_sibapp/ig_as_lnx150_as_lnx151

NTAP_CLONE_SECONDARY_VOLUMES=fas6280a:fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_ctl,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_bin,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_sibapp,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_redo,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_data2,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_data1,fas6280b/sv_as_lnx150_as_lnx151_oraprod6_dg_temp

from debug logs:

start with cloning of “bin” volume

########## Secondary volume clone is enabled and using secondary details. ##########

[2013-10-09 18:54:29,841] INFO: Creating Volume Clone from Snapshot copy snapC_DWH-weekly_20131009185035 of fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_bin

[2013-10-09 18:54:33,269] INFO: STORAGE-02036: Creating clone [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035] of volume [sm_as_lnx150_as_lnx151_oraqual6_dg_bin] based on Snapshot copy [snapC_DWH-weekly_20131009185035].

[2013-10-09 18:54:33,270] DEBUG: <volume-clone-create>

<parent-snapshot>snapC_DWH-weekly_20131009185035</parent-snapshot>

<parent-volume>sm_as_lnx150_as_lnx151_oraqual6_dg_bin</parent-volume>

<space-reserve>none</space-reserve>

<volume>cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035</volume>

</volume-clone-create>

[2013-10-09 18:54:33,270] INFO: STORAGE-02037: Creating clone [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035] of volume [sm_as_lnx150_as_lnx151_oraqual6_dg_bin] based on Snapshot copy [snapC_DWH-weekly_20131009185035] finished successfully.

[2013-10-09 18:54:33,270] INFO: Successfully created volume clone from Snapshot copy sm_as_lnx150_as_lnx151_oraqual6_dg_bin of fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_bin

[2013-10-09 18:54:33,456] INFO: STORAGE-02050: Listing luns.

[2013-10-09 18:54:33,456] DEBUG: <lun-stats-list-info/>

Lun is onlined and mapped correctly

[2013-10-09 18:54:33,456] INFO: STORAGE-02051: Listing luns finished successfully.

[2013-10-09 18:54:33,456] INFO: Creating igroup map for /vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001 on fas6280b:cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035

[2013-10-09 18:54:33,583] INFO: STORAGE-03003: Making lun [q_oraprod6_dg_bin/oraprod6_dg_bin_001] online on vol [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035].

[2013-10-09 18:54:33,583] DEBUG: <lun-online>

<path >/vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001</path >

</lun-online>

[2013-10-09 18:54:33,583] INFO: STORAGE-03004: Lun-online of lun [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035] on vol [q_oraprod6_dg_bin/oraprod6_dg_bin_001] finished successfully.

[2013-10-09 18:54:33,701] INFO: STORAGE-02022: Mapping igroup [ig_as_lnx150_as_lnx151] on lun [/vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001].

[2013-10-09 18:54:33,701] DEBUG: <lun-map>

<initiator-group >ig_as_lnx150_as_lnx151</initiator-group >

<path>/vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001</path>

</lun-map>

[2013-10-09 18:54:33,701] INFO: STORAGE-03000: Mapping igroup [ig_as_lnx150_as_lnx151] on lun [/vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001] finished successfully.

[2013-10-09 18:54:33,703] INFO: Creating Volume Clone from Snapshot copy snapC_DWH-weekly_20131009185035 of fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_redo

[2013-10-09 18:54:37,037] INFO: STORAGE-02036: Creating clone [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_redo_20131009185035] of volume [sm_as_lnx150_as_lnx151_oraqual6_dg_redo] based on Snapshot copy [snapC_DWH-weekly_20131009185035].

[2013-10-09 18:54:37,037] DEBUG: <volume-clone-create>

<parent-snapshot>snapC_DWH-weekly_20131009185035</parent-snapshot>

<parent-volume>sm_as_lnx150_as_lnx151_oraqual6_dg_redo</parent-volume>

<space-reserve>none</space-reserve>

<volume>cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_redo_20131009185035</volume>

</volume-clone-create>

The second clone was created (REDO volume)

[2013-10-09 18:54:37,037] INFO: STORAGE-02037: Creating clone [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_redo_20131009185035] of volume [sm_as_lnx150_as_lnx151_oraqual6_dg_redo] based on Snapshot copy [snapC_DWH-weekly_20131009185035] finished successfully.

[2013-10-09 18:54:37,037] INFO: Successfully created volume clone from Snapshot copy sm_as_lnx150_as_lnx151_oraqual6_dg_redo of fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_redo

[2013-10-09 18:54:37,167] INFO: STORAGE-02050: Listing luns.

[2013-10-09 18:54:37,167] DEBUG: <lun-stats-list-info/>

[2013-10-09 18:54:37,167] INFO: STORAGE-02051: Listing luns finished successfully.

[2013-10-09 18:54:37,167] INFO: Creating igroup map for /vol/cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035/q_oraprod6_dg_bin/oraprod6_dg_bin_001 on fas6280b:cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035

[2013-10-09 18:54:37,278] INFO: STORAGE-03003: Making lun [q_oraprod6_dg_bin/oraprod6_dg_bin_001] online on vol [cl_oracle_sm_as_lnx150_as_lnx151_oraqual6_dg_bin_20131009185035].

[2013-10-09 18:54:37,278] ERROR: com.netapp.snapcreator.storage.executor.ZapiExecutorException: netapp.manage.NaAPIFailedException: LUN is not currently offline (errno=9015)

Why works again with BIN lun !!! and not with redo lun ?????????

what's happened? a bug?

sivar · ‎2013-10-14

Mauro,

Looks like you gave us config file from prod but the logs from qual.

From the IAG,

controller1:controller1-sec/vol1,vol2,vol3;controller2:controller2-sec/vol1;controller3:controller3-sec/vol2,vol3.

NTAP_CLONE_SECONDARY_VOLUMES=fas6280a:fas6280b/sm_as_lnx150_as_lnx151_oraprod6_dg_ctl,sm_as_lnx150_as_lnx151_oraprod6_dg_bin,sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp,sm_as_lnx150_as_lnx151_oraprod6_dg_redo,sm_as_lnx150_as_lnx151_oraprod6_dg_data2,sm_as_lnx150_as_lnx151_oraprod6_dg_data1,sm_as_lnx150_as_lnx151_oraprod6_dg_temp

Please let me know the behavior after this modification.

Regards,
Siva Ramanathan

Snap Creator Community Moderator

mauro · ‎2013-10-15

i've modified the variable.

I'm not able to try the "clonevol" action due to impossibility to shutdown database (offline backup on production).

i would like to test with the "mount" action using existing snapshot. (pre and post mount are similar to pre post clone)

UMOUNT_CMD01=CLONETARGET:/opt/netapp/script_sc/post_umount_test.sh

MOUNT_CMD01=CLONETARGET:/opt/netapp/script_sc/post_mount_test.sh

PRE_CLONE_CREATE_CMD01=CLONETARGET:/opt/netapp/script_sc/post_umount_test.sh

POST_CLONE_CREATE_CMD01=CLONETARGET:/opt/netapp/script_sc/post_mount_test.sh

When i run the "mount" action i can choose only snapshots from source machine ..

it searches from souce machine fas6280a and not from the secondary fas6280b

INFO: Creating Volume Clone from Snapshot copy snapC_DWH-weekly_20131009185035 of fas6280a:sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp

Volume 'sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp' was not found (in fact the volume is on fas6280b !!!!)

The relationship is managed by DFM:

NTAP_DFM_DATA_SET=fas6280a:snapcreator_oracle/as_lnx180_as_lnx181_oraprod6_dg_bin,as_lnx180_as_lnx181_oraprod6_dg_ctl,as_lnx180_as_lnx181_oraprod6_dg_data1,as_lnx180_as_lnx181_oraprod6_dg_data2,as_lnx180_as_lnx181_oraprod6_dg_temp,as_lnx180_as_lnx181_oraprod6_dg_redo,as_lnx180_as_lnx181_oraprod6_dg_sibapp

NTAP_PM_RUN_BACKUP=Y

NTAP_PM_UPDATE=Y

NTAP_DFM_SNAPSHOT_FORMAT=

I don't konw what i should insert in "SNAPMIRROR_VOLUMES=" variables (should i use it ??)

(This is the list of source storage systems and volumes on which you want to perform a SnapMirror update,)

I've tried with

SNAPMIRROR_VOLUMES=fas6280a:as_lnx180_as_lnx181_oraprod6_dg_redo,as_lnx180_as_lnx181_oraprod6_dg_ctl,as_lnx180_as_lnx181_oraprod6_dg_data1,as_lnx180_as_lnx181_oraprod6_dg_data2,as_lnx180_as_lnx181_oraprod6_dg_bin,as_lnx180_as_lnx181_oraprod6_dg_temp,as_lnx180_as_lnx181_oraprod6_dg_sibapp

but i have the same problems..

sivar · ‎2013-10-15

NTAP_CLONE_SECONDARY=Y

NTAP_CLONE_SECONDARY_VOLUMES=fas6280a:fas6280b/sm_as_lnx150_as_lnx151_oraprod6_dg_ctl,sm_as_lnx150_as_lnx151_oraprod6_dg_bin,sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp,sm_as_lnx150_as_lnx151_oraprod6_dg_redo,sm_as_lnx150_as_lnx151_oraprod6_dg_data2,sm_as_lnx150_as_lnx151_oraprod6_dg_data1,sm_as_lnx150_as_lnx151_oraprod6_dg_temp

The Snap Creator GUI mount action will let you choose the source filer / volume / snapshot only.

But, with the above two options, your mount workflow knows that it has to clone from the secondary volume.

Please try with the above option (may be start with only volume), and let me know the results.

You may email me a scdump to sivar at netapp.com so that I can review.

mauro · ‎2013-10-15

Mauro Cesarano

Sinergy S.p.A.

C.so Svizzera 185

10149 Torino

Tel.+39-011-74116312 Fax. +39-011-74116320

Cell. +39-348-4417627[cid:image004.png@01CD73CE.50BCA550]

E-Mail: m.cesarano@sinergy.it<mailto:m.cesarano@sinergy.it>

@-mail: sinergy@sinergy.it<blocked::mailto:sinergy@sinergy.it> - Web: http://www.sinergy.it<blocked::http://www.sinergy.it/>

Sede: Segrate(MI)

Filiali: Bologna – Genova – Padova – Roma – Torino

P Please consider the environment before printing this e-mail

Nota di riservatezza: Il presente messaggio con i relativi allegati, contiene informazioni da considerarsi strettamente riservate ed è destinato esclusivamente alle persone espressamente indicate, che sono le uniche autorizzate ad usarlo sotto la propria responsabilità. Chiunque venisse in possesso di questo messaggio senza esserne autorizzato, è tenuto a distruggerne l’originale ed ogni sua copia in qualsiasi forma e darne immediata comunicazione al mittente.

Da: Siva Ramanathan

Inviato: martedì 15 ottobre 2013 16:03

A: Cesarano Mauro

Oggetto: - Re: clonevol action failed on NTAP_CLONE_IGROUP_MAP

<https://communities.netapp.com/index.jspa>

Re: clonevol action failed on NTAP_CLONE_IGROUP_MAP

created by Siva Ramanathan<https://communities.netapp.com/people/sivar> in Snap Creator - View the full discussion<https://communities.netapp.com/message/118618#118618>

NTAP_CLONE_SECONDARY=Y

NTAP_CLONE_SECONDARY_VOLUMES=fas6280a:fas6280b/sm_as_lnx150_as_lnx151_oraprod6_dg_ctl,sm_as_lnx150_as_lnx151_oraprod6_dg_bin,sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp,sm_as_lnx150_as_lnx151_oraprod6_dg_redo,sm_as_lnx150_as_lnx151_oraprod6_dg_data2,sm_as_lnx150_as_lnx151_oraprod6_dg_data1,sm_as_lnx150_as_lnx151_oraprod6_dg_temp

The Snap Creator GUI mount action will let you choose the source filer / volume / snapshot only.

But, with the above two options, your mount workflow knows that it has to clone from the secondary volume.

Please try with the above option (may be start with only volume), and let me know the results.

You may email me a scdump to sivar at netapp.com so that I can review.

< /div>

Reply to this message by replying to this email -or- go to the message on NetApp Community<https://communities.netapp.com/message/118618#118618>

Start a new discussion in Snap Creator by email<mailto:discussions-community-products_and_solutions-databases_and_enterprise_apps-snapcreator@communities.netapp.com> or at NetApp Community<https://communities.netapp.com/choose-container.jspa?contentType=1&containerType=14&container=2481>

mauro · ‎2013-11-07

we have seen that the action "mount" is not scheduled to make “NTAP_CLONE_SECONDARY”

But we need to "mount" on secondary ….

We have modified (green in what we have added..)

SNAPMIRROR_VOLUMES=fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_temp,sm_as_lnx150_as_lnx151_oraqual6_dg_data1,sm_as_lnx150_as_lnx151_oraqual6_dg_data2,sm_as_lnx150_as_lnx151_oraqual6_dg_sibapp,sm_as_lnx150_as_lnx151_oraqual6_dg_ctl,sm_as_lnx150_as_lnx151_oraqual6_dg_redo,sm_as_lnx150_as_lnx151_oraqual6_dg_bin

VOLUMES=fas6280a:as_lnx180_as_lnx181_oraprod6_dg_redo,as_lnx180_as_lnx181_oraprod6_dg_ctl,as_lnx180_as_lnx181_oraprod6_dg_data1,as_lnx180_as_lnx181_oraprod6_dg_data2,as_lnx180_as_lnx181_oraprod6_dg_bin,as_lnx180_as_lnx181_oraprod6_dg_temp,as_lnx180_as_lnx181_oraprod6_dg_sibapp;fas6280b:sm_as_lnx150_as_lnx151_oraqual6_dg_temp,sm_as_lnx150_as_lnx151_oraqual6_dg_data1,sm_as_lnx150_as_lnx151_oraqual6_dg_data2,sm_as_lnx150_as_lnx151_oraqual6_dg_sibapp,sm_as_lnx150_as_lnx151_oraqual6_dg_ctl,sm_as_lnx150_as_lnx151_oraqual6_dg_redo,sm_as_lnx150_as_lnx151_oraqual6_dg_bin

We tested the mount action, with errors..:

########## Secondary volume clone is enabled and using secondary details. ##########

[2013-11-05 17:04:03,770] INFO: Source controller fas6280b not configured for cloning, skipping

[2013-11-05 17:04:03,770] INFO: Creating Volume Clone from Snapshot copy snapC_DWH-weekly_20131009181433 of fas6280a:sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp

[2013-11-05 17:04:03,879] INFO: STORAGE-02036: Creating clone [cl_oracle_sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp_20131105170403] of volume [sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp] based on Snapshot copy [snapC_DWH-weekly_20131009181433].

[2013-11-05 17:04:03,879] ERROR: com.netapp.snapcreator.storage.executor.ZapiExecutorException: netapp.manage.NaAPIFailedException: Volume 'sm_as_lnx150_as_lnx151_oraprod6_dg_sibapp' was not found. (errno=13040)

ktenzer · ‎2013-11-07

VOLUMES and SNAPMIRROR_VOLUMES parameter should reflect primary volumes only not secondary. The purpose of SNAPMIRROR_VOLUMES is to indicate which primary volumes or subset should be snapmirrored.

The only parameter which has secondary information is NTAP_CLONE_SECONDARY_VOLUMES. This maps primary to secondary in case of secondary cloning.

It looks like you may have a configuration issue?

Regards,

Keith

sivar · ‎2013-11-12

Hello Mauro,

If you are still looking for help with this, please email me directly to sivar at netapp.com

I can work with you on this.

Thanks,

Siva Ramanathan

mauro · ‎2013-12-11

This is a bug resolved with snapcreator 4.1 (about to be released).

The system expects more luns on the same volumes. With one lun for volume it gets confused..