cancel
Showing results for 
Search instead for 
Did you mean: 

Child and Parent pipeline having count issue

Rahul
New Contributor III

When I am executing the parent pipeline the child pipeline has a different count and in the parent, the pipeline has a different count.

child pipeline execution :
image

parent pipeline execution (pipeline execute snap)

image

The child and parent pipeline don’t have any filter or router.
Child pipeline
image

Parent 🙂
image

12 REPLIES 12

Thanks. I don’t have a good explanation for the discrepancy between the number of output documents reported by the child (16838) vs the Pipe Exec that executed that child (16797). I think there might be a bug as you suggested. I suggest opening a ticket with SnapLogic Support about this. Please include this info:

  • Parent: pipe_runtime_id=58b7a2d080b28239d980b31f_e742d951-e350-4805-91e6-a37ca471ab18
  • Child: pipe_runtime_id=58b7a2d080b28239d980b31f_1f5879d3-d325-4949-ac78-bef6d0d40361
  • Slack (internal discussion thread)

Also, please note that this child execution was actually the 4th attempt. There were 3 failed attempts of that child pipeline in the few minutes before the one that succeeded where the REST Get failed with a 404. Here’s one of them:
https://elastic.snaplogic.com/sl/designer.html#pipe_runtime_id=58b7a2d080b28239d980b31f_c6780f37-34c...

I don’t know whether these failures are related to the document count discrepancy for the child that succeeded.

marjan_karafilo
Contributor

Hi @Rahul ,

Did you check for duplicate rows (data) while processing in child pipeline?
Also, are you ignoring empty data in child pipeline in CSV Parser?

Maybe in Parent pipeline, the CSV Formatter is set to ignore empty stream, so you see different count values.

BR,
Marjan

@marjan.karafiloski in CSV parser I am using ignore empty data and child pipeline and pipeline execute have a different count.

child :
image

pipeline execute in parent pipeline :
image