โ05-31-2019 12:15 PM
My input file is zipped. Inside the zip file, there are 3 fixed width file. I have to unzip the file and read each file(one at a time) and load into table. The input file will be in S3. Can someone advise to handle this scenario
Earlier when there was only one input file, i was able to successfully unzip and load the file. But this is not working when there are multiple files. Below snaps i have used when there is only one pipeline and it worked successfully.
Directory Browser -->S3 File Readerโ>Decompressโ>Transcoderโ>Fixed Width Parserโ> Mapperโ> Target
โ05-31-2019 12:49 PM
It sounds like youโre looking for the ZipFile Read snap and not Decompress.
โ05-31-2019 01:47 PM
i think you are right. I did a sample test and it is moving through each file. I will develop further and keep you posted.
Thanks for your quick response. It helps.