Forum Discussion
@darshthakkar
i already posted in [How to load Today Date Files from s3 Bucket to SLDB] using router snap.
my drought is for example we have 3 csv and 4 excel files after browsing from s3 bucket.i want to load all csv in one end point and remaining excel file in another end points.
Thank you
M Sathish
Try using this:
Wildcard is your file format, it will go into a single route for one format.
- arunsadhasivam6 years agoNew Contributor
no i tried json-splitter but the thinhg is it is returning collection of url , i need one url from collection at a time and use that url should be in rest post . let me know any option. i need some thing like queue or forloop. i tried sequence which can generate a counter 1-n records but i could not keep iterate over it.
i am new to snaplogic, i see only option is push to queue . but iam looking for some option other than this .- arunsadhasivam6 years agoNew Contributor
let me know if any option i missed in json splitter which could allow loop over collection one at a time.
The Splitter should be doing that for you. Can you maybe take a screenshot of your pipeline and a separate one of the Splitter configuration that you were trying at the time. We can take a look and try to figure out what is going on.
Note that when building a pipeline, you’re trying to setup the different stages of processing that will be applied to the data that is flowing through it. There’s not really any looping going on. So, in your case, you’re receiving the data, maybe validating it, and then doing the REST POST. The Splitter is needed to reshape the data flow to expand the single input doc into multiple output docs that can go through the remaining stages of the pipeline.