09-27-2022 07:57 AM
Hello Community,
I want to iterate the pipeline when expression get true,below is my current pipeline design
In this pipeline I am checking count of Null values of column if all values Null then pipeline wait for 20 Sec and again try to fetch data from system, If its not Null then simply load the data into Snowflake.
My requirement is that after 20 Sec pipeline should check if there is full data available or not in continues loop.
Can you please advise me here how can I iterate this pipeline
Solved! Go to Solution.
09-28-2022 05:39 AM
@swatifunde - Here is an example that calls a triggered task until a desired result is returned. I’ve also attached the pipeline that it is calling so you can correlate the query results with the Has Next property in the REST Get.
Community 13497 - Child - Query Snowflake Table_2022_09_28.slp (2.7 KB)
Community 13497 - Poll Snowflake Table_2022_09_28.slp (6.6 KB)
Please note that calling a triggered task on an extremely frequent schedule will create a large amount of noise in your Dashboard. It is possible you may also experience some occasional failures calling the task due to network traffic. If your org has Ultra Tasks enabled, this would resolve the additional traffic in Dashboard and has excellent response since it avoids instantiating a new pipeline with each call.
09-28-2022 07:45 AM
Did you update the URL expression in the Mapper snap to your triggered task url?
09-29-2022 12:06 AM
yes, I did it
09-29-2022 04:11 AM
its working now but can you just confirm on thing here
I used Has Next parameter as per attachment so I want to know that until unless this condition get false it will continuously check the data on source system, right??
09-29-2022 07:55 AM
Yes - it will continually check until the Not_null value is non-zero and then it will stop calling URL.
09-29-2022 08:57 AM
Great!!! Thank you so much for your support 😀