Is there a way to figure out which snap in a pipeline is causing the performance bottleneck ? Not sure how accurate the statistics information of snap in pipeline execution statistics .
Have you gone through the documentation for the execution statistics dialog? In particular, pay attention to the Duration bars for the Snaps. Snaps with long blue bars are spending their time executing, while Snaps with long green and purple bars are waiting for upstream or downstream snaps to finish working. So, snaps with long blue bars are typically the bottleneck.
Do you have reason to believe they are not accurate? If you can provide some examples, we can take a look.
Not only more time consumed also other factors like memory & CPU usage . Also I meant to do this in a pipeline and send an alert about that pipeline, snaps and other required details. When multiple team using the tool and all of them sharing same nodes for execution, this would be really helpful.
