How to loop thru a REST snap
Hello,
I am trying to load transaction data from a REST API end point. The API has pagination as required Input parameter. I am using the REST GET to fetch the data and the Https URL should be as b...
Forum Discussion
The REST Get snap will output documents, which downstream you could write out to a database, another web service, etc… Could you talk more about what you’re trying to do?
Do we have any option to stop iteration after some time to process less volume rather too much.
Example
Assume Api has 1000 pages and 1000 times has next = true and Next URL is running.
it is too much collecting 1000 pages document in rest get and processing next snap and we are getting Snap was aborted and java util concurrent issues etc…
Is there any option to set “has next”= false explicitly, though API is returning true after 10 iteration so that we can process only 10 pages rather than 1000 pages.
You can stop the iteration if the response returns which page is the current page. So for example if the response returns something like:
{ . . currentPage: 9, hasNext: true, . . }Your logic to stop the iteration would be:
$entity.response.hasNext == true && $entity.response.currentPage <= 10Here, the iteration will be from page 1 to page 10 and then the
Has nextattribute becomes false which means it will stop the iteration.Thanks a lot @j.angelevski , this api is just returning has next=true/false along with new page token but it is helpful, will check what other parameter we can use from response to break the loop.
@j.angelevski , API response side no parameter to terminate after 10 number of iteration.
We should implement another parameter next url call limit along with has next, next url for looping in rest API.Since server side design various company to company, in this case if it would have to page number concept then it was easy to handle but in this case instead of page number, it has next new token for has next =true.
Alternate way we can use head snap to read first 10 iteration for next processing but rest snap still running until 1000 iteration to be completed.
Is there any other snap we can consider to find some alternate for his.
