Designing and Running Pipelines

Pipeline execute snap in an ultra task: pool size when reuse executions disabled

Hello, I have an ultra pipeline task that executes a pipeline which uses the Pipeline Execute snap with: Reuse executions unchecked andPoolsize > 1 I was expecting this pipeline to process multiple documents in parallel but when I inspect the SnapLo...

JSON lines

Hello, My pipelines are in two stages. Pipeline 1. File pipeline I’m loading 5 records of Json data to a s3 file with ‘Json Lines’ attribute checked. Pipeline 2. Using the s3 file created in Pipeline 1 in a REST POST, to call an API by passing it as...

Storing the delete history

Hi Team, I have designed a very simple one-one pipeline which performs Salesforce Delete operation based on the id we receive from the source mapper . After deleting I would like to write to the file regarding the details performed after deletion lik...

Unpivoting a variable number of columns (date columns)

Was following @ptaylor’s excellent article on Medium on Transforming and Visualizing COVID-19 Data and was trying to do something similar using, coincidentally, COVID-19 data from a different source, and got a bit stuck. I got to the point where you...

API call fails to complete in child pipeline

Hello, I am trying to run a parent-child pipeline using the pipeline execute snap. Lately, I have been getting the error mentioned below in one of the child pipeline instances. The other child pipeline instances complete successfully. This specific c...

How to fetch field values after group by snap which are not part of group

Hi, After using group by logic for combination of fields the downstream snaps are loosing the values. Example: Input file fields: field1, field2 field3, field4,Test1,test2 group by Logic Used for: field1, field2 field3 after above step : values are n...

GroupN - Failing for a specific case

We query DB (collects the events generated by Parent system) and grouping the records based on field “Type”. Using GroupN, I get all the records for that particular type. Using this list of recordValues, we retrieve rest of the information from Paren...

XML file to send to SAP directory structure

Hi Team, I am trying to send an xml file to SAP system. Client has provided hostname, port and the directory structure like /usr/…/…/ like this. Few queries I have :- a. Is it possible to send an entire xml file to SAP system? b. Does SAP directory i...

SnapLogic - Integration Nation

Forum Posts

Pipeline execute snap in an ultra task: pool size when reuse executions disabled

JSON lines

Storing the delete history

Unpivoting a variable number of columns (date columns)

API call fails to complete in child pipeline

How to fetch field values after group by snap which are not part of group

GroupN - Failing for a specific case

XML file to send to SAP directory structure

Trim and convert string into Date

How to output the SQL statement that was executed ...

How to identify if there are no files in the sourc...

Decode column name that has @ as a prefix

Cannot call parameter in the error pipeline

Formatting CSV data for XML output

Get MIN (oldest) or MAX (most recent) date from ar...

Line Break in Mapper

how to filter out spaces

Expression to extract values in nested JSON object...