Forum Discussion

darshthakkar's avatar
darshthakkar
Valued Contributor
10 months ago
Solved

Fetch dashboard/monitor details via a pipeline

Hi Team,

I was looking into a possibility of fetching pipeline execution details (along with its execution frequency which is not available at the moment) via a snapLogic pipeline.
Ideally, I would want to fetch everything that is available in Dashboard/Monitor (as this would be replacing the traditional dashboard) and then pass that information to downstream systems. We can start off with pipeline execution details and then work through fetching everything from Dashboard.

(Execution frequency not available)

Thanking in advance for your time and assistance.

6 Replies

  • walkerline117's avatar
    walkerline117
    Contributor
    7 years ago

    yes,sorry i didn’t use clear words, but you are right, what I mean is a document with an array of values.

  • walkerline117's avatar
    walkerline117
    Contributor
    7 years ago

    So in my use case, its simple: I have 5 input documents, each document is an array of values.
    e.g. the first array has 3 values, the 2 array has 2 values.

    after the CSV formatter, i want to see 5 documents/files( the first one should have 3 rows, the second one should have 2 rows…)

    The 5 documents comes out of a mapper snap, then I tried to put a CSV formatter snap behind the mapper, i noticed that the number of output of the CSV is not 5, but 1 document contains all values across all arrays.

    Then I tried to move just the CSV formatter to a subpipeline, I got the same result.

    • tstack's avatar
      tstack
      Former Employee
      7 years ago

      Since the CSV Formatter currently doesn’t work with arrays, you will need to use a child pipeline that splits the array into separate docs that go into a CSV Formatter.

      I’m attaching a couple of pipelines to demonstrate this flow:

      FormatArrayToCSV_2019_02_28.slp (5.6 KB)
      WriteCSVFiles_2019_02_28.slp (5.4 KB)

      The FormatArrayToCSV pipeline is the child. It splits the “$array” property in the incoming document and then passes the results to a CSV Formatter and FileWriter. You’ll need to change the JSON Splitter to split your array property.

      The WriteCSVFiles pipeline is the parent. It just contains some mock data and feeds it into the child pipeline.