Forum Discussion

maahutch's avatar
maahutch
New Contributor
2 years ago
Solved

Backing up two database tables to an S3 bucket as one archive

I'm trying to develop a pipeline that queries two (or more) database tables, converts them to CSV, compresses them to a single archive and writes them to and S3 bucket. I have a working pipeline for ...
  • koryknick's avatar
    koryknick
    2 years ago

    maahutch - update the input views in the ZipFile Write snap to accept multiple inputs so your pipeline looks like this:

    Note that you will want to name your input views based on the filename you want to see in the archive and make sure you include the extension for the filename as part of the view name.  

    Note the 3 slashes following the s3: protocol designation before your S3 bucket name and make sure you check the "Use input view label" option.

    Hope this helps!

koryknick's avatar
koryknick
Employee
2 years ago
Copy Link

maahutch - update the input views in the ZipFile Write snap to accept multiple inputs so your pipeline looks like this:

Note that you will want to name your input views based on the filename you want to see in the archive and make sure you include the extension for the filename as part of the view name.  

Note the 3 slashes following the s3: protocol designation before your S3 bucket name and make sure you check the "Use input view label" option.

Hope this helps!