How to loop thru N times
I have an input of 1000 Records coming in. I can only process 200 records at a time. How can I write a loop for this ?
Forum Discussion
aakumar - I think you misunderstood what endor_force was proposing. I think the suggestion to use Pipeline Execute with a "Batch size" setting of 200 is the right solution. You can remove the Group By N in your parent pipeline with this option. Basically, this will send groups of 200 records to a child pipeline and when that child has finished processing those 200 records, it will finish and as long as the parent more documents to process, it will continue to start child pipelines and send groups of 200 records.
Hope this helps!
