Designing and Running Pipelines

Throttle Bot or Other Loop/Delay Mechanism?

I have a process where I am submitting a data load to an engine that reviews the data. I want to accomplish a couple things. First - I want to be able to have the Pipeline pause for a delay I specify. Second - I want the Pipeline to then “loop” and p...

Issue while adding days to date field in mapper

Hi, I have a scenario where I am trying to increment a date field by 7 days in loop till it reaches another date value. I see data type as date for the field I am working, still while using plusDays(7) function I am getting error. I couldn’t date.par...

How to capture the Trigger task API headers

Hi, I want to capture all the headers passed to a Triggered task. Generally they are hidden in the Pipeline Parameters in a triggered execution. Based on a header ‘User-Agent’ we have to take an action. Could someone please help with info on this?

SCD2 implemmetation in snaplogic using azure snappacks

I have a database table in azure sql and I am getting daily data from a dataset,then I have to compare dataset record with database table records and 1 : Insert the records that are present in dataset but not in database into database in sql 2 Apply...

I want to insert brand new records and update the already exits records using azure snappacks how I can do in snaplogic

I want to insert brand new records and update the already exits records using azure snappacks how I can do in snaplogic. In short I want to implement SCD2 in snaplogic using azure snappacks.

Resolved! Add incoming document to new file row

We want the ability to write a document to a new row within a CSV file. This is only if the document meets certain requirements Is this possible? This article from a few years back suggests not and wondered if there has been any advancements

How are pipeline executions distributed across a Snaplex?

When a request to run a pipeline is submitted against a Snaplex,the Control Plane must decide which member node to send the request to. In making that decision,the Control Plane assumes that each node in a Snaplex is homogenous in terms of both hardw...

Strange issue - data and email results the same but email doesn't come on execute, only on preview

To keep things simple, Email snap is set with Validate & Execute so that it will fire on preview tests as well as execute. Data is simple, pulls 46 rows from a table, merges the count i.e. 46 and sends the results to an email. Email comes reliabilit...

SnapLogic - Integration Nation

Forum Posts

Throttle Bot or Other Loop/Delay Mechanism?

Issue while adding days to date field in mapper

How to capture the Trigger task API headers

SCD2 implemmetation in snaplogic using azure snappacks

I want to insert brand new records and update the already exits records using azure snappacks how I can do in snaplogic

Resolved! Add incoming document to new file row

How are pipeline executions distributed across a Snaplex?

Strange issue - data and email results the same but email doesn't come on execute, only on preview

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...