Forum Discussion

sdeng's avatar
sdeng
New Contributor II
7 years ago
Solved

How to generate dynamic file name by using pipeline execute

We’re using pipeline execute to run the tasks in parallel by check Reuse executions to process documents and changed Pool Size. But in the pipeline execute called pipeline, it will generate a log fil...
amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago
Copy LinkReport

Hi Rajesh,

Yes it’s Bulk load redshift. It checks for a condition in redshift select snaps and if it’s true, it self execute again till the condition is false.

So the set of snaps in this pipeline will be executed again and again in loop till false.

Other than updating account settings batch and pool size, is there a way to address this slow execution.?

Regards,
Amar.

Related Content