Forum Discussion

alex_panganiban's avatar
alex_panganiban
Contributor
3 years ago
Solved

Using sl.zipObject with Headerless CSV

Hoping someone might be able to find a solution to a challenge I have. I have a headerless csv file. I’m also reading in a header array that I wish to match up with the data in the headerless csv. I ...
  • alex_panganiban's avatar
    alex_panganiban
    3 years ago

    I got my solution! @Spiro_Taleski, thank you so much for your wisdom! This is what Spiro showed me.

    I applied his solution to the bigger challenge I was having and this sample pipeline does exactly what I needed it to do.

    sample_ConfiguredHeadersToData_2022_11_23.slp (8.0 KB)

    Thank you all!

    Alex

bojanvelevski's avatar
bojanvelevski
Valued Contributor
4 years ago
Copy LinkReport

Hey @philliperamos ,

https://elastic.snaplogic.com/api/1/rest/public/runtime/<ORG>/<PIPE_RUUID>

use this endpoint if you like to get details about specific execution of the pipeline. If you need to get complete details related to a pipeline, use this one:

https://elastic.snaplogic.com/api/1/rest/public/runtime/<ORG>?pipe_name=<PIPELINE_NAME>&last_hours=24

  • bojanvelevski's avatar
    bojanvelevski
    Valued Contributor
    5 years ago
    Copy LinkReport

    Hi @shawnharv,

    Try and wrap the payload into one object, and pass that object into the Entity field in the REST Post snap.

    Something like this:

    [
    {
    “payload”: {
    “kind”: “doubleclicksearch#conversionList”,
    “conversion”: [
    {
    “clickId”: “XXXXXXXXXXXXXXXXXXMYaAunkEALw_wcB”,
    “conversionId”: “XXXXXXXXXXXzhXE5AAM”,
    “conversionTimestamp”: “1623361621000”,
    “segmentationType”: “FLOODLIGHT”,
    “segmentationName”: “SFDC_Wins”,
    “type”: “ACTION”
    },
    {
    “clickId”: “XXXXXXXXXXXXd69532af3081b22f4”,
    “conversionId”: “XXXXXXXXXXXXXzhW2pAAE”,
    “conversionTimestamp”: “1623352858000”,
    “segmentationType”: “FLOODLIGHT”,
    “segmentationName”: “SFDC_Wins”,
    “type”: “ACTION”
    }
    ]
    }
    }
    ]

    Don’t forget the Content-Type Header:

    • shawnharv's avatar
      shawnharv
      New Contributor
      5 years ago
      Copy LinkReport

      Thanks [bojanvelevski] for the quick response.

      I tried wrapping this in the payload object like you suggested, but still no success. The doubleclick search API responds with “The request was not valid. Details: [Empty batch encountered]”.

      Its very strange how the payload works when its coming from a JSON generator snap, but the same JSON payload coming from a file fails. The two are literally the same haha.

      Thanks,
      Shawn

      • ptaylor's avatar
        ptaylor
        Employee
        5 years ago
        Copy LinkReport

        Please review and post a screenshot of the Pipeline Execution Statistics of each version of the pipeline – the one with the JSON Generator and the one without. This will give us more information about exactly how many input documents are being received by the REST Post.