Batch Load Snap for calling RESTFUL API (HTTP GET)

[jshanaiah]

Do we have Snap that can call RESTFUL API in batch of 50 or 100
@sinhavivek @kpatnala

[ptaylor]

Can you please elaborate? Are you trying to deal with a service that returns possibly multiple pages, like a search?

[jshanaiah]

Nope… We were trying to get data while migration from vendors to our DB… Vendors have exposed their data through RESTFUL API or SOAP .

Millions of record in question. We can’t do one at a time

[Harriesh]

Check this out whether it helps for you

How to wait child pipeline till parent pipelines are completed Designing Pipelines

How to wait child pipeline till parent pipelines are completed. Currently the child pipelines are getting executed before the parent execution done with all the documents. Because of that it is having memory issue. Is there any wait to wait the child pipeline till all the documents execution and then call the child pipeline.