Forum Discussion

amubeen's avatar
amubeen
New Contributor II
4 years ago

Reading and parsing multiple files from s3 bucket

Hey All, So I’ve been able to read a single csv file from my s3 bucket, parse it with csv parser, map it, and load it into my snowflake DB with some additional join logic. However, what I need to d...
amubeen's avatar
amubeen
New Contributor II
4 years ago

Would I use a single file reader in that case or a multi file reader? Wasn’t sure about what the difference was

bojanvelevski's avatar
bojanvelevski
Valued Contributor
4 years ago

Single. But because directory browser will produce multiple documents, the file reader will be called as many times as there will be documents on input.