How to iterate the pipeline

[swatifunde]

Hello Community,

I want to iterate the pipeline when expression get true,below is my current pipeline design

In this pipeline I am checking count of Null values of column if all values Null then pipeline wait for 20 Sec and again try to fetch data from system, If its not Null then simply load the data into Snowflake.
My requirement is that after 20 Sec pipeline should check if there is full data available or not in continues loop.

Can you please advise me here how can I iterate this pipeline

[koryknick]

My pleasure! I’m happy you got a solution that works for you!

[swatifunde]

koryknick when I am trying to test this pipeline with some dummy data then it is not giving expected response. when there is no data then also it get executed within 20 sec. I don’t think so it is looping there

[koryknick]

@swatifunde - Please verify that your child pipeline returns the results you are expecting during your testing. Remember that the REST Get will complete as soon as the “Has next” condition is true; however, it will return whatever value the query returns every Pagination interval. If you don’t want to do anything until Not_null is 0, then you can use a Tail snap to wait for the last value (i.e. Not_null is zero).