Subscribe

Fileserver Migration with robocopy

I want to migrate data from am Windows2012 server to a NetApp CIFS share.

 

robocopy \\winserver\source \\vserver\destination /MIR /COPYALL /XO /FFT

 

It does the initial copy without errors. In the second run I ant to copy only changed files, but robcopy incorrectly recognizes everythig as changed and does the whole job again. Between two Windows servers robocopy works as expected. Only modified files are transferred in the second run.

 

Anybody else with this problem?

 

Holger Zickner

Re: Fileserver Migration with robocopy

I read an article on an unrelated issue that says for copying updated files and changed permissions with robocopy, the following syntax should be used.

> ROBOCOPY <source> <target> /MIR /SEC /SECFIX

https://blogs.technet.microsoft.com/filecab/2008/07/31/robocopy-mir-switch-mirroring-file-permissions/

 

I am not a robocopy expert, so I cannot confirm this will fix your problem. 

 

Thanks,

Re: Fileserver Migration with robocopy

Hi,

 

For the initial sync we use:

  

robocopy \\source_share\folder \\destination_share\folder /E /V /ZB /R:1 /W:1 /NP /COPYALL /LOG:c:\robocopy.log

 

Explanation:

  • /E          -              copy subdirectories, including Empty ones.
  • /V          -              produce Verbose output, showing skipped files.
  • /ZB        -              use restartable mode; if access denied use Backup mode.
  • /R:1      -              number of Retries on failed copies
  • /W:1     -              Wait time between retries: default is 30 seconds
  • /NP       -              No Progress - don't display percentage copied. 
  • /COPYALL          COPY ALL file info (equivalent to /COPY: DATSOU)
  • /LOG    -              LOG location

After the initial sync you can use the following command to copy only the changes:

  

robocopy \\source_share\folder \\destination_share\folder /MIR /V /ZB /R:5 /W:5 /NP /COPYALL /LOG:c:\robocopy.log

 

Explanation:

  • /MIR    -              MIRror a directory tree (equivalent to /E plus /PURGE).

 

Kind regards,

 

 

Re: Fileserver Migration with robocopy

Yes, so my assertion is that the /copyall switch is what the problem may be.

Re: Fileserver Migration with robocopy

Hi,

 

I really would like to see if somebody had found a solution.

 

After the copy baseline towards netapp cdot 8.3.1 with robocopy the update "marks" every file as changed

This creates a huge logfile and extends the robocopy update job.

 

Doing excactly the same copy to a windows destination is not showing existing files not as changed.

 

 

br,

Christian Smet

Re: Fileserver Migration with robocopy

Hello,

 

 

I have tried with the below option with full permission on source and destination and its works. I copied near by 6 TB of data without error. Can you try this below option instead of using other options?

 

 

> ROBOCOPY <source> <target> /MIR /SEC /SECFIX

/MIR will replicate data and security (as /SEC is specified) for changed files, and /SECFIX will update just the security for unchanged files. Add /V to the command line if you want to see which files are having their security “fixed” without having their data copied.

 

Thanks,

 

Re: Fileserver Migration with robocopy

Hi,

 

thanks for the reply.

We are using below options.

 

Options : *.* /V /S /E /DCOPYSmiley Very HappyA /COPYSmiley Very HappyATS /SECFIX /PURGE /MIR /R:0 /W:0

 

The problem is that the same options act different on a Windows destination compared with our current Netapp destination.

Above options tread every file as changed.  So there are no files skipped on the incremental.

When we do the same on a windows destination it skips the files.  Only some dirs.

 

Below incremental on a Netapp destination for a 5TB volume that has already had a first baseline.

So it took almost 100hrs just to check 5TB on changes?

 

------------------------------------------------------------------------------

               Total    Copied   Skipped  Mismatch    FAILED    Extras
    Dirs :    571018      7366        14         0         0      3822
   Files :   4954222   4954204                 0        18     36030
   Bytes :   5.770 t   5.770 t         0         0     5.5 k  83.337 g
   Times :  97:32:00  83:04:45                       0:00:00  14:27:15


   Speed :            21212801 Bytes/sec.
   Speed :            1213.806 MegaBytes/min.
   Ended : 30 October 2016 13:41:44

 

 

br,

 

Christian Smet

 

Re: Fileserver Migration with robocopy

Found and solved....

 

http://www.noelis.be/?p=173

 

Re: Fileserver Migration with robocopy

We're having a similar issue where robocopy marks all files as "modified" on a subsequent run.

/fft parameter makes no difference. File size, modified time etc are all equal when checked in windows explorer

 

however, using robocopy on server 2008 instead of server 2012 does correctly recognise files as unmodified, resulting in a much quicker subsequent run.

 

I don't know if the settings you mention in your blog post are active or would make a difference.

Re: Fileserver Migration with robocopy

Hi BRECHTMON,

 

 

We have already finished everything by the procedure provided. 

Another workaround you can try is... the parameter /NOOFFLOAD with ROBOCOPY.

 

 I don't know why I didn't see that before.  It's worth a try :-)

 

br,

Christian Smet