cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Zip Snap file structure

SuryaReddy
New Contributor

I have a pipeline which reads data from an S3 location and writes to an SMB location with no transformations. The pipeline involves 2 main snaps, S3 reader connected to Zip write snap. The Zip write snap recreates the whole structure of the S3 location in the Zip file, which I would like to avoid and place all the files in either a root directory or a directory of my choice instead of copying the S3 structure.
As there is no transformation, I do not want to parse the files and parse back again. Is there a way of doing this?

5 REPLIES 5

Your current version of the pipeline, will write the zip file on SLDB under the name โ€œTESTlOG.zipโ€ . What am I suggesting is to use the expression above to get the actual filename youโ€™re reading from S3, and use that filename to write the file on SMB. Example:

image

image