Forum Discussion

ForbinCSD's avatar
ForbinCSD
Contributor
3 years ago

Programmatically get SLPROPZ contents and write to a file

Within a pipeline, how can I programmatically access the SLPROPZ file for a snaplex, and write the contents of the file out to the local hard drive?

We have over 500 snaplexes that we need to do this for, so manually downloading them all is not a good solution.

Also, for various reasons I won’t go into, we cannot employ an outside task that just pings each download endpoint. This HAS to be done from within a set of pipelines.

The SnapLogic Metadata snaps give me the ability to list Snaplexes and to read them as a set of JSON attributes. But there seems no way to obtain (or reconstruct) the SLPROPZ file.

Any help that can be provided will be much appreciated!

4 Replies

  • arunsadhasivam's avatar
    arunsadhasivam
    New Contributor

    let me know if any option i missed in json splitter which could allow loop over collection one at a time.

  • tstack's avatar
    tstack
    Former Employee

    The Splitter should be doing that for you. Can you maybe take a screenshot of your pipeline and a separate one of the Splitter configuration that you were trying at the time. We can take a look and try to figure out what is going on.

    Note that when building a pipeline, you’re trying to setup the different stages of processing that will be applied to the data that is flowing through it. There’s not really any looping going on. So, in your case, you’re receiving the data, maybe validating it, and then doing the REST POST. The Splitter is needed to reshape the data flow to expand the single input doc into multiple output docs that can go through the remaining stages of the pipeline.