cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Read multiple CSV in a S3 and load in diferente table

Marley_Bacelar
New Contributor II

Hi all,

I have a S3 bucket with 3 files with different name, I need to read these files and based in each name insert the data in different table.

Was thinking about: a S3 file browser - Mapper - Route - insert

Any suggestion?

1 ACCEPTED SOLUTION

pmancevski
New Contributor III

Hi @Marley_Bacelar,

File browser only it will give you some information about the files/objects you got in S3. You have couple of options here. You can use following snap packs:

  1. S3 snap pack.
  2. Binary snap pack (Directory Browse and File Reader)
  3. Or you can combine (but for this you will need to maintain multiple accounts)

Example with s3 snap pack (approach for binary will be similar) and also depending of the file formats your overall logic will be:
S3 file browser โ†’ S3 Download (this snap because you will need to maintain only one account) โ†’ Parser โ†’ mapper โ†’ router โ†’ insert.

Thanks,
Pero M.

View solution in original post

1 REPLY 1

pmancevski
New Contributor III

Hi @Marley_Bacelar,

File browser only it will give you some information about the files/objects you got in S3. You have couple of options here. You can use following snap packs:

  1. S3 snap pack.
  2. Binary snap pack (Directory Browse and File Reader)
  3. Or you can combine (but for this you will need to maintain multiple accounts)

Example with s3 snap pack (approach for binary will be similar) and also depending of the file formats your overall logic will be:
S3 file browser โ†’ S3 Download (this snap because you will need to maintain only one account) โ†’ Parser โ†’ mapper โ†’ router โ†’ insert.

Thanks,
Pero M.