cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to load Today Date Files from s3 Bucket to SLDB

sathishmadavali
New Contributor II

Hi,
I am getting the files from amazon s3 bucket every day, I want to load today date files from s3 bucket to SLDB.Any one can help me on that. Thanking you in advance.

Thanks
M SATHISH
s3 load

17 REPLIES 17

darshthakkar
Valued Contributor

@sathishmadavali : You can use 2 snaps over here:

  1. Multi-File Reader and provide the path ensuring that the wildcard only takes into consideration the format youโ€™re looking for (e.g. csv). You will have to specify multiple paths if youโ€™re wanting to read multiple files.

  2. Using router โ†’ if you go into views, you can add additional views for which you can write different functions like $objectKey == โ€œtesting.csvโ€, second function would be $objectKey == โ€œtesting.jsonโ€ so on and so forth. This works if youโ€™re having $objectKey in your upstream.

Moreover, I would also urge to open a new topic as we have branched out from reading todayโ€™s file to separating files. Thankyou.

CC: @dmiller @AleksandarAngelevski

darshthakkar
Valued Contributor

@sathishmadavali - I have created a new topic: Routing files from S3

darshthakkar
Valued Contributor

@sathishmadavali - Please mark the solution provided by @AleksandarAngelevski as โ€œsolutionโ€ so that this thread can be closed.