NetApp Community Update
This site will enter Read Only mode on July 23 as we prepare to move to a new platform. You will still be able to view content, but posting and replying will be temporarily disabled.
We're excited to launch our new Community experience on July 30 and more information will follow soon.
Stay connected during the transition - Join our Discord community today.

General Discussion

run ndmpcopy without overwriting files or duplication

Brandon3
849 Views

Hello, 

 

I want to run ndmpcopy from one volume to another on the same netapp, but I want to make sure that files that may already exist on the destination netapp are not duplicated and overfill the volume to 100%

 

Earlier I ran: node run -node node1 ndmpcopy -sa ndmpuser:yMGg5d0LyUG8l1kn -da ndmpuser:yMGg5d0LyUG8l1kn 10.63.107.200:/svm2/vol1 10.63.107.200:/svm2/vol2

 

But this resulted in the destination netapp being overfilled to 100%. Is there a way to make sure this doesn't happen? 

 

Both source volume had 500GB of storage and it was 66% full, the destination volume is also 500GB and was at 25% full.

1 REPLY 1

chamfer
745 Views

Hello @Brandon3,

 

Unfortunately, ndmpcopy doesn’t do deduplication or file-level checks.... it’s a straight copy operation. If the destination already has data, it won’t reconcile or skip duplicates, so you’ll want to plan around that. 

 

A couple of clarifying questions that will help narrow down the best approach for you:

  • What NetApp ONTAP platform are you running on (AFF, FAS, or ASA)?
  • Which ONTAP software version are you currently using? Some features and behaviors differ between releases.
  • What storage efficiency ratio are you seeing on the destination volume (deduplication, compression, compaction)?
  • Is the destination volume already serving data to clients, or is it purely a replication target?
  • Do you need this to be a one-time copy, or an ongoing sync/replication?

With those details, it’ll be easier to recommend whether ndmpcopy is the right tool, or if SnapMirror or XCP might be a better fit for your use case.

 

NDMP is a protocol designed for backups, and while you can still use it for copy operations you need to understand its limitations.  For example, you could have a heap of deduplicated data on your source volume (even 2:1) that is going to your destination volume with either deduplication disabled or even post-process deduplication (e.g. FAS)......... it will fill up.

 

There is also a great KB article here which discusses the incremental copy feature of ndmpcopy What is the difference between levels 1 to 9 for an incremental copy - NetApp Knowledge Base which depending on your use case could help.

Public