Loading multiple zip files from S3 to data base
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-03-2021 12:25 PM
Hi,
I am working on a scenario where I have multiple zip files from same S3 bucket location with file name as Upload* wildcard. I tried below snaps but it’s not working. Any tips?
Multi file reader → Binary to document → Mapper → Zip file reader
Directory browser → S3 file reader → binary to document - mapper → zip file reader
Kindly help.
Regards,
Amar
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-03-2021 12:58 PM
Hey @amardeep2021,
Add your S3 bucket path to a Directory Browser, following a ZipFile Read snap with $Path added in the “File” field. Don’t forget to check the equal sign to enable expressions.
Hope this helps,
Regards,
Bojan
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-03-2021 01:19 PM
Thanks Bojan. I have tried the same. But, I don’t see the directory browser output in the zip file reader snap File field. Am I missing something? Please let me know.
Regards,
Amar.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-03-2021 02:48 PM
Write down the $Path field even if it doesn’t show up in the input schema. It must be a glitch or something. Here’s the result:
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-04-2021 11:57 AM
It works! Thanks Bojan.