Amazon S3 Batch Replication synchronizes existing data between buckets
Amazon S3 Replication is an elastic, fully managed, low-cost feature that replicates newly uploaded objects across two or more Amazon S3 buckets, keeping buckets in sync. Now, with S3 Batch Replication, you can synchronize existing objects between buckets.
Amazon S3 Replication is an elastic, fully managed, low-cost feature that replicates newly uploaded objects across two or more Amazon S3 buckets, keeping buckets in sync. Now, with S3 Batch Replication, you can synchronize existing objects between buckets.
You can use S3 Batch Replication to backfill a newly created bucket with existing objects, retry objects that were previously unable to replicate, migrate data across accounts, or add new buckets to your data lake. S3 Batch Replication works on any amount of data, giving you a fully managed way to meet your data sovereignty and compliance, disaster recovery, and performance optimization needs. You can get started with S3 Batch Replication with just a few clicks in the S3 Console or a single API request.
To initiate S3 Batch Replication, you can either provide a list of objects to replicate, or have Amazon S3 compile a list for you by specifying the source bucket and additional filters such as object creation date and replication status. The S3-generated list is called a Manifest and you can review it before the job starts to ensure the list of objects is correct. S3 Batch Replication is built using S3 Batch Operations to asynchronously replicate objects. Similar to other S3 Batch Operations jobs, you will have full visibility into the job’s progress, including the running time and percentage of objects completed. You can also receive a detailed completion report with the status of each object upon completion.
S3 Batch Replication complements the existing S3 Replication features: Same-Region Replication (SRR) and Cross-Region Replication (CRR). While SRR and CRR automatically replicate new objects between buckets, you can now replicate existing objects using S3 Batch Replication. S3 Batch Replication also replicates objects regardless of their replication status, i.e., whether they have never been replicated, were unable to replicate previously, or were previously replicated as part of another workflow.
S3 Batch Replication is available in all AWS Regions, including the AWS GovCloud (US) Regions, the AWS China (Beijing) Region, operated by Sinnet, and the AWS (Ningxia) Region, operated by NWCD. You can get started with S3 Batch Replication through the S3 console, AWS Command Line Interface (CLI), Application Programming Interface (API), or AWS Software Development Kit (SDK) client. For pricing information, please visit the Replication tab of the Amazon S3 pricing page. To learn more about S3 Batch Replication, visit the S3 User Guide or read the AWS News Blog.