Sort snap not competing even after 24 hrs
Hi Team,
I had a requirement where I have to use a sort snap and this sort needs to sort 50000 documents. But after processing 3057 documents, this snap kind of stuck keeps on validating but not pr...
Forum Discussion
@hirakangshu.nag - please look at your pipeline execution statistics and find the light blue duration bar - this is where the pipeline is actually spending it’s time in execution. More than likely, the Sort snap is dark blue indicating that it is waiting on output to the downstream snaps. My guess is that it is “hung” at a database read/update or a Join snap using unsorted input.
It likely succeeds with smaller datasets because the end of input is hit before the downstream snap that is causing the deadlock starts buffering documents between snaps.
