โ07-28-2021 10:35 AM
Hi Team,
I had a requirement where I have to use a sort snap and this sort needs to sort 50000 documents. But after processing 3057 documents, this snap kind of stuck keeps on validating but not processing the next documents.
Itโs running for 24 hours. Sort order I m using as global. Could u pls let me know the reason why itโs not completing.
If I process less documents same pipeline works fine. Whatโs the option we xam use to fix this.
Regards
Hirak
โ09-28-2021 03:29 AM
Hi there,
Was there a resolution for this?
I have an event driven pipeline but the documents are not being passed through the pipeline and are stuck at the Sort snap. Removing this affects are data downstream as it becomes unstructured. The Sort snap proceeds a Group by Field snap.
Seems like this is a SnapLogic flaw?
โ09-28-2021 09:47 AM
Hello Nai,
What do you mean by โan event driven pipelineโ? For a Sort snap to complete and produce meaningful output, it must have a complete data set, so the input stream must end. My guess is that the input to the Sort isnโt ending.