QUESTION - Data Transfer amounts reporting available in OM/PM?

[emanuel]

Posting for kcheung@netapp.com ( Kathy Cheung - onsite at Genentech ); please direct questions to her ( she tried to log in but got errors )

Is there a report that we can run in DFM to see how much data is collected on snapmirred or snapvault per night between site to site ( source and destination )?

[kcheung]

Please reply back to kcheung@netapp.com

[adaikkap]

Yes,Pls look at the below reports.

# dfm report list | grep -i dp-transfer

dp-transfer-backup-individual DP Transfer Backup, Individual

dp-transfer-backup-daily DP Transfer Backup, Daily

dp-transfer-backup-weekly DP Transfer Backup, Weekly

dp-transfer-backup-monthly DP Transfer Backup, Monthly

dp-transfer-backup-quarterly DP Transfer Backup, Quarterly

dp-transfer-backup-yearly DP Transfer Backup, Yearly

dp-transfer-mirror-individual DP Transfer Mirror, Individual

dp-transfer-mirror-daily DP Transfer Mirror, Daily

dp-transfer-mirror-weekly DP Transfer Mirror, Weekly

dp-transfer-mirror-monthly DP Transfer Mirror, Monthly

dp-transfer-mirror-quarterly DP Transfer Mirror, Quarterly

dp-transfer-mirror-yearly DP Transfer Mirror, Yearly

dp-transfer-dataset-daily DP Transfer Dataset, Daily

dp-transfer-dataset-weekly DP Transfer Dataset, Weekly

dp-transfer-dataset-monthly DP Transfer Dataset, Monthly

dp-transfer-dataset-quarterly DP Transfer Dataset, Quarterly

dp-transfer-dataset-yearly DP Transfer Dataset, Yearly

#

Regards

adai

[emanuel]

Okay ... getting close.  We found the command line and gui portions of this but are only seeing "half the transfers".

Here is what we have: I have a 30 day testing running which is half way done; there is very little data in this small volume but what I am hoping to do is list out the number of bytes transfered on each backup; if it is 0 then that is okay.  At genentech they have much more running and these reports should be producing more data to look at.  Are these "DP" reports specific only to manually created snapvaults and snapmirrors?  How can i see reports on backups and DRs created from Protection Manager?

Each time i look for one of my Protection Manager backups, I get "There are no dp_transfers"  ... what does DP stand for?

Our Protection Manager schedules: ( 1311 and 1129 are mine )

C:\Users\emanuel>dfpm schedule list
Id     Type     Schedule Name
------ -------- ----------------------------------------------------------------
    46 daily    Daily at 8:00 PM
    44 daily    Daily at midnight with hourly
    48 monthly  First Sunday at 8:00 PM plus weekly and daily
    51 daily    Five minutes past midnight
   878 daily    Hourly at every 2 hours
    50 daily    Hourly on half hour
    49 daily    Hourly on the hour
    52 monthly  Last Sunday at 8:00 PM plus weekly and daily
  1311 daily    Mixed_Daily
  1129 daily    NTFS_Daily
    47 weekly   Sunday at 8:00 PM plus daily
    45 weekly   Sunday at midnight with daily and hourly

C:\Users\emanuel>dfpm backup list 1148
Backup Id Backup Version        Retention Type Node Name            Description
--------- --------------------- -------------- -------------------- -----------------------------------
     2687 28 Apr 2010 23:30:05  daily          NTFS Backup Systems
     2610 27 Apr 2010 23:30:04  daily          NTFS Backup Systems
     2532 26 Apr 2010 23:30:02  daily          NTFS Backup Systems
     2495 24 Apr 2010 23:30:06  daily          NTFS Backup Systems
     2418 23 Apr 2010 23:30:06  daily          NTFS Backup Systems
     2340 22 Apr 2010 23:30:02  daily          NTFS Backup Systems
     2263 21 Apr 2010 23:30:02  daily          NTFS Backup Systems
     2186 20 Apr 2010 23:30:02  daily          NTFS Backup Systems
     2110 19 Apr 2010 23:30:05  daily          NTFS Backup Systems
     2032 18 Apr 2010 23:30:06  daily          NTFS Backup Systems
     1955 17 Apr 2010 23:30:05  daily          NTFS Backup Systems
     1878 16 Apr 2010 23:30:05  daily          NTFS Backup Systems
     1801 15 Apr 2010 23:30:06  daily          NTFS Backup Systems
     1724 14 Apr 2010 23:30:06  daily          NTFS Backup Systems
     1647 13 Apr 2010 23:30:05  daily          NTFS Backup Systems
     1570 12 Apr 2010 23:30:06  daily          NTFS Backup Systems
     1494 11 Apr 2010 23:30:02  daily          NTFS Backup Systems
     1416 10 Apr 2010 23:30:02  daily          NTFS Backup Systems
     1339 09 Apr 2010 23:30:03  daily          NTFS Backup Systems
     1263 08 Apr 2010 23:30:03  daily          NTFS Backup Systems
     1185 07 Apr 2010 23:30:02  daily          NTFS Backup Systems
     1109 06 Apr 2010 23:30:03  daily          NTFS Backup Systems
     1033 05 Apr 2010 23:30:05  daily          NTFS Backup Systems
      957 04 Apr 2010 23:30:02  daily          NTFS Backup Systems
      881 03 Apr 2010 23:30:02  daily          NTFS Backup Systems
      805 02 Apr 2010 23:30:03  daily          NTFS Backup Systems
      729 01 Apr 2010 23:30:01  daily          NTFS Backup Systems
      653 31 Mar 2010 23:30:06  daily          NTFS Backup Systems
      580 30 Mar 2010 23:30:05  daily          NTFS Backup Systems

[adaikkap]

The report works for all QSM/SV/VSM relationship created by DFBM or DFDRM or Protection Manager or Filer Cli.

what I am hoping to do is list out the number of bytes transferred on each backup

For that you must look at the dp-transfer-backup-individual or dp-transfer-mirror-individual report that give how data was transfer for each relationship.

We don’t have a report that gives how much data was transferred per schedule of a dataset.

But that can be got from the dp-transfer-mirror/backup-individual report by doing a sum of all the data transferred for each relationship that belong to the dataset.

Regards

adai

[emanuel]

I found something interesting in Protection Manager ... the number of bytes transfered is reporting as UNKNOWN.

In this capture, I enabled bytes transfered and it is coming up as unknown; in the GUI and command line I get these:

C:\Users\emanuel>dfm report view dp-transfer-backup-individual
There are no dp_transfers.

So ... I have some sort of disconnect with my backups and reporting; even though when i goto the RESTORE wizard, I can see backed up data files.

[smoot]

If the job is short, we'll always report "Unknown" for bytes transferred in the job progress messages. This is because we don't get really accurate values from ONTAP and we don't want to report a number we know is incorrect.

The dp-transfer reports get their values by parsing the snapmirror.log file on the destination storage system. Look there and see if the transfers you expect were really logged. If not, that's why they are not in the report.

[adaikkap]

IIRC datatransfer jobs which complete less than 3 minutes show bytes transferred as unknown in the NMC jobs page as well as the cli dfpm job details page.

Regards

adai