Forum Discussion

amubeen's avatar
amubeen
New Contributor II
4 years ago

Reading and parsing multiple files from s3 bucket

Hey All, So I’ve been able to read a single csv file from my s3 bucket, parse it with csv parser, map it, and load it into my snowflake DB with some additional join logic. However, what I need to d...
amubeen's avatar
amubeen
New Contributor II
4 years ago

Would I use a single file reader in that case or a multi file reader? Wasn’t sure about what the difference was

Supratim's avatar
Supratim
Contributor III
4 years ago

@amubeen hi… if you want to use Multi File Reader , you can config like below. But make sure all of your file should adhere same format (same set of header) else record can be mismatched. You can use filename convention in wildcard set.