How we can Migrate s3 Bucket folders to Another Bucket

[Rahul]

Hi,

I have a requirement to create s3 bucket folders from one bucket to another bucket with the same structure.

[bojanvelevski]

Hey @Rahul,

You can easily read one file that in the current bucket directories, and re-write it into the new bucket by replacing the old bucket with the new one in the content-location header.

Make sure you check the Create directory if not present option. You may achieve this with File Operation as well, but I’m not sure.

[Rahul]

@bojanvelevski Thanks But in Source s3 folder have multiple subfolders and subfolders have multiple subfolders. we need to follow same hierarchy and create in Target S3 Bucket folder.

[bojanvelevski]

Yes, I already assumed that. My suggestion was to get all folders and subfolders with multiple Directory Browsers and at the end, one file from each lowest level is enough to recreate the whole structure.

[Rahul]

@bojanvelevski can you Please Share your pipeline