Pagination of documentation

[Harriesh]

Hi ,

Is there anyway we can paginate the document process ?
When we are processing the huge set of data it is leading to spiking of RAM usage. is there anyway I can process the documents set by set so that it takes care there is no spiking in RAM usage.

[Harriesh · Accepted solution]

How to wait child pipeline till parent pipelines are completed Designing Pipelines

How to wait child pipeline till parent pipelines are completed. Currently the child pipelines are getting executed before the parent execution done with all the documents. Because of that it is having memory issue. Is there any wait to wait the child pipeline till all the documents execution and then call the child pipeline.

This helped to solve the issue. It would have been nice same thing is given as a single snap 🙂