How to replicate the logic equivalent to while loop in Snaplogic pipelines

[MuraliNagula]

There is a child pipeline which returns values like completed, in queue, processing etc. The requirement is that parent pipeline to run this child pipeline till it returns Completed, of-course after certain wait time. Its like while loop, run the child pipeline, till the expression is true. How do accomplish this in snaplogic ?

Appreciate any pointers…

[MuraliNagula]

All these are REST API Get/POST jobs

[tstack]

MuraliNagula:

The parent pipeline queues up a bulk job to export records.

What do you mean by “queue up” here? Is the queue in an external service and the children are pulling from there? Maybe I’m misunderstanding.

I guess I would expect the parent pipeline to pull from the queue and let the PipelineExecute snap distribute documents to child executions.

MuraliNagula:

The child pipeline keeps getting the status of the job every 60 seconds to get the status till it reaches its end state.

Sorry, I’m having trouble visualizing the parent and child pipelines here. Would you be able to attach a screenshot of them or an SLP export?

[MuraliNagula]

Yes. Its external (Marketo) service.Parent submits a bulk job and in the response object we get a exportID. We have to keep checking the status (REST Get Call to Marketo) of this export job thru another Marketo endpoint which happens in a child pipeline. This child pipeline should be running in while loop kind of thing till we get a success/failure response. Picture of child pipeline attached.

[psadasivam]

@MuraliNagula - This can be achieved using "Has next "and “Next URL” properties. Below rest snap invokes Next URL based on Has next flag. You can refer Snap documentation for more info.

[tstack]

psadasivam:

This can be achieved using "Has next "and “Next URL” properties.

I just wanted to add on that you should set the ‘Pagination interval’ as well so that the requests aren’t made too quickly.