Designing and Running Pipelines

Resolved! Conversion of json file to Reltio Specific format

Hello, We are creating a data interface between snaplogic and reltio with a .json file. Reltio expects the .json file to be in a specific format as below: Notice the ‘new line’ i.e ‘\n’ inserted after every record of json data. We tried scripts hook,...

Pipeline execute snap in an ultra task: pool size when reuse executions disabled

Hello, I have an ultra pipeline task that executes a pipeline which uses the Pipeline Execute snap with: Reuse executions unchecked andPoolsize > 1 I was expecting this pipeline to process multiple documents in parallel but when I inspect the SnapLo...

JSON lines

Hello, My pipelines are in two stages. Pipeline 1. File pipeline I’m loading 5 records of Json data to a s3 file with ‘Json Lines’ attribute checked. Pipeline 2. Using the s3 file created in Pipeline 1 in a REST POST, to call an API by passing it as...

Storing the delete history

Hi Team, I have designed a very simple one-one pipeline which performs Salesforce Delete operation based on the id we receive from the source mapper . After deleting I would like to write to the file regarding the details performed after deletion lik...

Unpivoting a variable number of columns (date columns)

Was following @ptaylor’s excellent article on Medium on Transforming and Visualizing COVID-19 Data and was trying to do something similar using, coincidentally, COVID-19 data from a different source, and got a bit stuck. I got to the point where you...

API call fails to complete in child pipeline

Hello, I am trying to run a parent-child pipeline using the pipeline execute snap. Lately, I have been getting the error mentioned below in one of the child pipeline instances. The other child pipeline instances complete successfully. This specific c...

How to fetch field values after group by snap which are not part of group

Hi, After using group by logic for combination of fields the downstream snaps are loosing the values. Example: Input file fields: field1, field2 field3, field4,Test1,test2 group by Logic Used for: field1, field2 field3 after above step : values are n...

GroupN - Failing for a specific case

We query DB (collects the events generated by Parent system) and grouping the records based on field “Type”. Using GroupN, I get all the records for that particular type. Using this list of recordValues, we retrieve rest of the information from Paren...

SnapLogic - Integration Nation

Forum Posts

Resolved! Conversion of json file to Reltio Specific format

Pipeline execute snap in an ultra task: pool size when reuse executions disabled

JSON lines

Storing the delete history

Unpivoting a variable number of columns (date columns)

API call fails to complete in child pipeline

How to fetch field values after group by snap which are not part of group

GroupN - Failing for a specific case

Best Approach for Handling CSV Import with Truncat...

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?