Child and Parent pipeline having count issue

[Rahul]

When I am executing the parent pipeline the child pipeline has a different count and in the parent, the pipeline has a different count.

child pipeline execution :

parent pipeline execution (pipeline execute snap)

The child and parent pipeline don’t have any filter or router.
Child pipeline

Parent 🙂

[ptaylor]

Thanks. I don’t have a good explanation for the discrepancy between the number of output documents reported by the child (16838) vs the Pipe Exec that executed that child (16797). I think there might be a bug as you suggested. I suggest opening a ticket with SnapLogic Support about this. Please include this info:

• Parent: pipe_runtime_id=58b7a2d080b28239d980b31f_e742d951-e350-4805-91e6-a37ca471ab18
• Child: pipe_runtime_id=58b7a2d080b28239d980b31f_1f5879d3-d325-4949-ac78-bef6d0d40361
• Slack (internal discussion thread)

Also, please note that this child execution was actually the 4th attempt. There were 3 failed attempts of that child pipeline in the few minutes before the one that succeeded where the REST Get failed with a 404. Here’s one of them:
https://elastic.snaplogic.com/sl/designer.html#pipe_runtime_id=58b7a2d080b28239d980b31f_c6780f37-34c...

I don’t know whether these failures are related to the document count discrepancy for the child that succeeded.

[marjan_karafilo]

Hi @Rahul ,

Did you check for duplicate rows (data) while processing in child pipeline?
Also, are you ignoring empty data in child pipeline in CSV Parser?

Maybe in Parent pipeline, the CSV Formatter is set to ignore empty stream, so you see different count values.

BR,
Marjan

[Rahul]

@marjan.karafiloski in CSV parser I am using ignore empty data and child pipeline and pipeline execute have a different count.

child :

pipeline execute in parent pipeline :