Exception handling in pipeline

[IgnatiusN]

Is there a way to handle exceptions across the pipeline. If we have 100 records streaming, we want to route any record that failed to a log file, and still process all the remaining records.

Handling error in each snap looks very tedious, and I wanted to check if there was anything we could do to handle exceptions across the pipeline and route it to an error view.

[smakkena]

If you call the pipeline from a parent pipeline using PipelineExecute snap, and enable error view on the PE snap, then any and all errors in the child pipeline should be propagated to the Error view.

[aleung]

smakkena:

call the pipeline from a parent pipeline using PipelineExecute snap, and enable error view on the PE snap, then any and all errors in the child pipeline should be propagated to the Error

Having been on the platform over 2 years. Unlike traditional coding this isn’t necessary, instead only use the error view in the “write” type of snap (if needed).