Forum Discussion

brent_vanallen's avatar
brent_vanallen
New Contributor
4 years ago

Throttle Bot or Other Loop/Delay Mechanism?

I have a process where I am submitting a data load to an engine that reviews the data. I want to accomplish a couple things.

First - I want to be able to have the Pipeline pause for a delay I specify.

Second - I want the Pipeline to then “loop” and peridically check back using a DB lookup (Postgres Execute should work) to check the status of the submitted data…and do some kind of loop until it finds the status it wants, a timeout would be handy too in case it never finds the proper “complete” status.

Once it does find the right status it is looking for it would then continue past the loop condition and fire off post-processing steps in the database to clean data up, extract results of the submitted batch, etc.

I have seen a Snap referred to in the documentation as a “Throttle Bot Snap” in some examples (for instance this one https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2067890766/Use+Case+Employee+Onboarding), but I cannot actually find the snap itself or the Snap Pack it must come in. If anyone can help me with the above technical issue or tell me how to find the Throttle Bot Snap that woould be very appreciated.

Thank You,

Brent Van Allen
Aduro.

10 Replies

  • neelamanikandan's avatar
    neelamanikandan
    New Contributor II

    Hi RogerSramkoski  It was a question, in the above example I had 2 (Servicecompany and Servicecompanydetail) fields that had values in array, so I have used 2 JSON splitters in the pipeline. But if my input JSON contains multiple(eg. 10) array fields should I always use multiple (10 JSON splitters) in the pipeline? Is there alternate Snap that can flatten all the Array elements at one go, or is there an alternative approach to use the JSON splitter to flatten all arrays