07-28-2021 10:35 AM
Hi Team,
I had a requirement where I have to use a sort snap and this sort needs to sort 50000 documents. But after processing 3057 documents, this snap kind of stuck keeps on validating but not processing the next documents.
It’s running for 24 hours. Sort order I m using as global. Could u pls let me know the reason why it’s not completing.
If I process less documents same pipeline works fine. What’s the option we xam use to fix this.
Regards
Hirak
09-28-2021 03:29 AM
Hi there,
Was there a resolution for this?
I have an event driven pipeline but the documents are not being passed through the pipeline and are stuck at the Sort snap. Removing this affects are data downstream as it becomes unstructured. The Sort snap proceeds a Group by Field snap.
Seems like this is a SnapLogic flaw?
09-28-2021 09:47 AM
Hello Nai,
What do you mean by “an event driven pipeline”? For a Sort snap to complete and produce meaningful output, it must have a complete data set, so the input stream must end. My guess is that the input to the Sort isn’t ending.