โ06-14-2019 12:08 AM
Hello all,
I have to deal with API with paging. In the body of the response I received not only data but also cursor(pointer to the next page of data). I used REST POST snap.
The API was designed to return a large dataset and thatโs why the API should be kicked-off couple times with the same input parameters + pointer to the next page.
For now, I have no Idea how to implement this correctly.
Appreciated for any help.
Solved! Go to Solution.
โ06-21-2019 07:20 AM
Hello, not sure that I can, but here it is a skeleton.
The main idea is if we received an error, we should recall the pipeline with the same parameters, if not we should call the pipeline with the same parameter except cursor( in my case). I got value for the cursor parameter and check it before next iteration. If it not null I recall pipeline with the new cursor + all parameters.
Get next idโs list and recurse snap I used for call the pipeline again
โ06-21-2019 07:20 AM
Hello, not sure that I can, but here it is a skeleton.
The main idea is if we received an error, we should recall the pipeline with the same parameters, if not we should call the pipeline with the same parameter except cursor( in my case). I got value for the cursor parameter and check it before next iteration. If it not null I recall pipeline with the new cursor + all parameters.
Get next idโs list and recurse snap I used for call the pipeline again
โ10-13-2021 11:40 AM
Pipeline Execution documentation mentions that a pipeline calling itself, recursion, is not supported. Is there a way it works though? Looks like you are calling the same pipeline.
โ06-21-2019 09:57 AM
Thank you, Ed. I think weโre on the same page!