Forum Discussion

ADORAISWAMY's avatar
ADORAISWAMY
New Contributor II
5 years ago

How to pass values to a child snap

I am a newbie to Snaplogic. I am developing a pipeline to copy data from Oracle tables to Snowflake using Snaplogic. I have created a parent pipeline and used “Pipeline Execute” to pass values to th...
djsiegel's avatar
djsiegel
Former Employee
4 years ago
Copy LinkReport

@nsingam : Thank you for your example! That’s a good step-by-step example of how someone can change the format of the data for use elsewhere, and even accommodates the other metadata items 2 and 3.

I do happen to really like @koryknick 's example, however, since it leaves the rest of the object intact, and is a very elegant example of the Object.mapKeys() function! His manages to get to the target system format in 2 snaps. It’s pretty neat that we have both a mapKeys and mapValues in our toolbox to use in situations like this.

Here’s the sample pipeline that does the transformation.
GravityFormsReassemble_2022_07_08.slp (8.8 KB)

Thank you both!

  • dmiller's avatar
    dmiller
    Former Employee
    8 years ago
    Copy Link

    Can you clarify in what way they are different?

    • akidave's avatar
      akidave
      Employee
      8 years ago
      Copy Link

      A document should not be modified once it has been written to the output view. Making a copy of the document avoids issues. Change the loop to create a new wrapper Map

               for item in sourceTables:
             wrapper = java.util.HashMap(in_doc)
             wrapper['query'] = "update iods_staging.{} set record_inserted = true;".format(item)
             self.output.write(wrapper)
      • aditya_sharma's avatar
        aditya_sharma
        New Contributor III
        8 years ago
        Copy Link

        Hi Akidave,

        Thanks you so much for your solution. However, I would really appreciate if you could explain me more why we should not modify the document once it has been written to the output view.

        Thanks again.

        Aditya

    • aditya_sharma's avatar
      aditya_sharma
      New Contributor III
      8 years ago
      Copy Link

      Hi Dmiller,

      Please find below output from script snap and mapper output. Mapper output has two update statements same which is incorrect, it has to be same like script.

      Script Snap:

      “query”: “update iods_staging.stg_sf_account_dim_institution set record_inserted = true;”
      “query”: “update iods_staging.stg_sf_accountdistict_dim_institution set record_inserted = true;”
      “query”: “update iods_staging.stg_sf_recordtype_dim_institution set record_inserted = true;”

      Mapper Output:

      “query”
      “update iods_staging.stg_sf_account_dim_institution set record_inserted = true;”
      “update iods_staging.stg_sf_recordtype_dim_institution set record_inserted = true;”
      “update iods_staging.stg_sf_recordtype_dim_institution set record_inserted = true;”

      Thanks
      Aditya

      • dmiller's avatar
        dmiller
        Former Employee
        8 years ago
        Copy Link

        Is there a reason you need the Mapper after the Script Snap? Do you plan to modify other information?

        If so and there are items like query that should not be modified, then select the Pass through option and don’t specify them in the mapping table.