06-08-2023 11:35 PM
Hi,
I am getting the files from amazon s3 bucket every day, I want to load today date files from s3 bucket to SLDB.Any one can help me on that. Thanking you in advance.
Thanks
M SATHISH
06-15-2023 05:58 AM
@sathishmadavali : You can use 2 snaps over here:
Multi-File Reader and provide the path ensuring that the wildcard only takes into consideration the format you’re looking for (e.g. csv). You will have to specify multiple paths if you’re wanting to read multiple files.
Using router → if you go into views, you can add additional views for which you can write different functions like $objectKey == “testing.csv”, second function would be $objectKey == “testing.json” so on and so forth. This works if you’re having $objectKey in your upstream.
Moreover, I would also urge to open a new topic as we have branched out from reading today’s file to separating files. Thankyou.
06-15-2023 06:02 AM
@sathishmadavali - I have created a new topic: Routing files from S3
06-15-2023 06:23 AM
@sathishmadavali - Please mark the solution provided by @AleksandarAngelevski as “solution” so that this thread can be closed.