How to load Today Date Files from s3 Bucket to SLDB

[sathishmadavali]

Hi,
I am getting the files from amazon s3 bucket every day, I want to load today date files from s3 bucket to SLDB.Any one can help me on that. Thanking you in advance.

Thanks
M SATHISH

[darshthakkar]

@sathishmadavali : You can use 2 snaps over here:

1. Multi-File Reader and provide the path ensuring that the wildcard only takes into consideration the format you’re looking for (e.g. csv). You will have to specify multiple paths if you’re wanting to read multiple files.

2. Using router → if you go into views, you can add additional views for which you can write different functions like $objectKey == “testing.csv”, second function would be $objectKey == “testing.json” so on and so forth. This works if you’re having $objectKey in your upstream.

Moreover, I would also urge to open a new topic as we have branched out from reading today’s file to separating files. Thankyou.

CC: @dmiller @AleksandarAngelevski

[darshthakkar]

@sathishmadavali - I have created a new topic: Routing files from S3

[darshthakkar]

@sathishmadavali - Please mark the solution provided by @AleksandarAngelevski as “solution” so that this thread can be closed.