Programmatically get SLPROPZ contents and write to a file
Within a pipeline, how can I programmatically access the SLPROPZ file for a snaplex, and write the contents of the file out to the local hard drive? We have over 500 snaplexes that we need to do this for, so manually downloading them all is not a good solution. Also, for various reasons I won’t go into, we cannot employ an outside task that just pings each download endpoint. This HAS to be done from within a set of pipelines. The SnapLogic Metadata snaps give me the ability to list Snaplexes and to read them as a set of JSON attributes. But there seems no way to obtain (or reconstruct) the SLPROPZ file. Any help that can be provided will be much appreciated!3.2KViews0likes4CommentsUnable to handle echo message
Hi all, I’m encountering this error for the first time but we have a ultra task api pipeline running. And today when Iwas testing out the api it gave the error message: Somehow knows what that means. I also saw in the dashboard that we sometime lose connection to the nodes so I found on the community. Lost contact with Snaplex node Designing Pipelines I have a very small pipeline (3 snaps) that I’m reading from a SQL table and writing the results to a new table in the same DB. I keep getting an error: Lost contact with Snaplex node while the pipeline was running. The select statement is pulling 250+M records and I’m using the Azure bulk insert to write. In order to avoid this error I keep having to reduce the batch size, from 20K to 10K to now 8K. Any thoughts on what could be causing the error? But i already have implemented a pipeline execute. and the CPU usage is very low someone knows the first error? Regards JensSolved4.4KViews0likes5CommentsLimit the number of pipelines running on a node at a time
Is there an option in Snaplex to limit the number of running pipelines? I currently only see an option to limit the number of Snaps but with multiple different pipelines running, this would not be ideal plus I believe it’s strictly for manual runs and not for tasks.4.7KViews0likes4Comments