โ06-08-2023 11:35 PM
Hi,
I am getting the files from amazon s3 bucket every day, I want to load today date files from s3 bucket to SLDB.Any one can help me on that. Thanking you in advance.
Thanks
M SATHISH
โ06-15-2023 05:58 AM
@sathishmadavali : You can use 2 snaps over here:
Multi-File Reader and provide the path ensuring that the wildcard only takes into consideration the format youโre looking for (e.g. csv). You will have to specify multiple paths if youโre wanting to read multiple files.
Using router โ if you go into views, you can add additional views for which you can write different functions like $objectKey == โtesting.csvโ, second function would be $objectKey == โtesting.jsonโ so on and so forth. This works if youโre having $objectKey in your upstream.
Moreover, I would also urge to open a new topic as we have branched out from reading todayโs file to separating files. Thankyou.
โ06-15-2023 06:02 AM
@sathishmadavali - I have created a new topic: Routing files from S3
โ06-15-2023 06:23 AM
@sathishmadavali - Please mark the solution provided by @AleksandarAngelevski as โsolutionโ so that this thread can be closed.