When I am executing the parent pipeline the child pipeline has a different count and in the parent, the pipeline has a different count.
child pipeline execution :
parent pipeline execution (pipeline execute snap)
The child and parent pipeline don’t have any filter or router.
Child pipeline
Parent 🙂
Hi @Rahul,
Can you check how much documents were processed in the child pipeline in the “CSV Parser” snap ? I can see that there is 1 input document that goes into the child pipeline which then the child generates 16,797 documents on the output but 16,838 document were processed. Did you check if there were any errors ? I can see that you have an error view on your pipeline execute snap, maybe some of the documents that were generated failed during the csv parser process or during the REST Get API ?
@j.angelevski In child pipeline CSV parser process 16838 records.
@ljupcho_machkovski @j.angelevski @dmiller There is the snaplogic bug in pipeline execute snap .?
As an addition to @j.angelevski 's post. You probably have some errors in the CSV data, so your pipe execute snap forwards those to the error view, and sends the rest to output. You can validate that just by hovering with your mouse on the Generate Report snap after execution, or click the Pipeline Statistics icon in the toolbar and check if something went to the error view on those particular snaps.
@bojanvelevski There are no records that went in error view.
Can you please provide a link to the parent execution?
Hi @Rahul ,
Did you check for duplicate rows (data) while processing in child pipeline?
Also, are you ignoring empty data in child pipeline in CSV Parser?
Maybe in Parent pipeline, the CSV Formatter is set to ignore empty stream, so you see different count values.
BR,
Marjan
@marjan.karafiloski in CSV parser I am using ignore empty data and child pipeline and pipeline execute have a different count.
child :
pipeline execute in parent pipeline :
