cancel
Showing results for 
Search instead for 
Did you mean: 

Cannot call parameter in the error pipeline

pranjbhatt
New Contributor III

I am building a generic error pipeline which will load error occuring in the source pipeline and write them/load them into a database. It will load data such as label, user, etc. on which the error takes place. 

In source pipeline, within within the pipeline parameters, I have used "Error Pipeline"  feature to input the pipeline that would handle error and load the data. But after defining the "Error Pipeline Parameters" (such as pipe.label), which will act as output from the source pipeline (and input to generic pipeline), the mapper within the generic pipeline fails to receive/identify parameters from source. 

I have used _ in the mapper expression followed by key name to call them into generic pipeline, but cannot do so. Is there any other way ?

This is the source pipeline 

pranj_0-1720306549803.png

 

This is my error generic pipeline

pranj_1-1720306657825.png

 

 

 

 

1 ACCEPTED SOLUTION

SpiroTaleski
Valued Contributor

@pranjbhatt 

Every parameter that you will define in the Error Pipeline Parameters on the main pipeline will be propagated to the Error pipeline(in case of error). 

SpiroTaleski_0-1720451773295.png

If you want to do a testing/validate only on error pipeline, you should define Parameters on the Error pipeline so you will not get the error as previous: 

SpiroTaleski_1-1720451995165.png

 

View solution in original post

7 REPLIES 7

SpiroTaleski
Valued Contributor

@pranjbhatt 

The in.TotalCound and out.totalCount functions will returns total number of documents that have passed through all of the Snap's.

About the resource utilization metrics, check the following post/pattern that uses the APIs for getting the current resource utilization.

@SpiroTaleski 

I tried out in.TotalCount within the pipeline parameters but receive an errorpranj_0-1720533124890.png

Error is as follows, takes place while validating the pipeline. I guess it not loading from parent pipeline to error handler 

pranj_1-1720533277858.png

 

SpiroTaleski
Valued Contributor

@pranjbhatt 

Unfortunately that function cannot be evaluated there/in pipeline parameters.

Both functions, in.TotalCound and out.totalCount gives the total input/output documents passed through the snap(where the functions are implemented).