topic Re: data transfer in Object Storage

data transfer

Elan_LV — Thu, 11 May 2023 12:35:49 GMT

to move approx. 14-16TB of data from domain to outside environment. Please someone suggest

Ontapforrum — Thu, 11 May 2023 13:30:22 GMT

Please elaborate your query. Data from 'domain' or 'data domain' storage unit ? To outside : where ? What is the data type?

Drew_C — Mon, 12 Jun 2023 02:21:16 GMT

NetApp's XCP is a pretty common recommendation for this sort of thing, as long as it fits your use case.

JFM — Thu, 12 Oct 2023 19:48:18 GMT

To my knowledge, xcp doesn't support objects but only NAS-based data copy.

chamfer — Wed, 11 Dec 2024 22:54:44 GMT

I know this is an old post, but I cannot just let this sit here.

I assume that you are using a NetApp S3 product, either ONTAP S3 or StorageGRID as you have posted this to the "Object Storage" forum.
I assume that when you state "Domain" you are refering to on-premises
I assume that when you state "outside environment" you are referring to Internet connected S3, such as AWS S3 or Azure Blob.

Based on this assumptions there are plenty of solutions and here are a few.

NetApp Cloud Sync https://docs.netapp.com/us-en/occm38/concept_cloud_sync.html#features
S3cmd https://s3tools.org/s3cmd-sync
AWS CLI https://blog.awsfundamentals.com/aws-s3-sync https://spacelift.io/blog/aws-s3-sync