07-06-2024 03:58 PM
I am building a generic error pipeline which will load error occuring in the source pipeline and write them/load them into a database. It will load data such as label, user, etc. on which the error takes place.
In source pipeline, within within the pipeline parameters, I have used "Error Pipeline" feature to input the pipeline that would handle error and load the data. But after defining the "Error Pipeline Parameters" (such as pipe.label), which will act as output from the source pipeline (and input to generic pipeline), the mapper within the generic pipeline fails to receive/identify parameters from source.
I have used _ in the mapper expression followed by key name to call them into generic pipeline, but cannot do so. Is there any other way ?
This is the source pipeline
This is my error generic pipeline
Solved! Go to Solution.
07-08-2024 08:20 AM
Every parameter that you will define in the Error Pipeline Parameters on the main pipeline will be propagated to the Error pipeline(in case of error).
If you want to do a testing/validate only on error pipeline, you should define Parameters on the Error pipeline so you will not get the error as previous:
07-08-2024 01:56 AM
Hi @pranjbhatt
First, why do you set the pipe.label as the expression library?
Second, on the generic error pipeline, I guess you are getting that error while validating the error pipeline? If you run/execute the main pipeline(not error handler), the parameter will be automatically propagated to the error handler.
If you want to test/do a validation on the error pipeline, you need to create a pipeline parameter(pipe_label) on the error generic process.
BR,
Spiro
07-08-2024 07:47 AM - edited 07-08-2024 07:53 AM
OK, first part is clear
How do I call details such as pipe.label, pipe.ruuid and snap.label directly by defining them into the error pipeline ?
Or do I need to define in parent pipeline before calling them to error pipeline ?
07-08-2024 08:20 AM
Every parameter that you will define in the Error Pipeline Parameters on the main pipeline will be propagated to the Error pipeline(in case of error).
If you want to do a testing/validate only on error pipeline, you should define Parameters on the Error pipeline so you will not get the error as previous:
07-08-2024 11:03 AM
That's great.
Is there a function that can log the Snap Statistics or map it using Mapper snap ? Details such as CPU, Memory and Documents