Hi there,
I know that we can receive notifications for Pipelines that run on Scheduled Tasks for a number of statuses such as started, stopped, failed and completed.
How can we do the same for a ...
Soumic_Mohanty - one simple solution is to use the error view on the Data Validator, then a Gate to collect the count of errors, followed by a Router to check if there were errors. Finally, re-read the file to begin processing only if there were no issues.
Note that you will want to set your Gate snap "Output Document Count" to either "Document count and first..." or "Document count and last..." option; otherwise, it will consume all input data into memory which could be very resource intensive and not recommended.
The Router then just needs to check the output from your Gate snap to determine if the error path fed into it had any records.