Designing and Running Pipelines

Parallel Reused Pipeline Executes Uneven Load

I’ve been trying to build out a pipeline that reuses pipeline executes across a pool size of 3 to get input documents on an even spread between them to take advantage of multiple cores on similar work between differing input documents. However, in pr...

Snowflake Bulk Upsert not taking pipeline parameters

I have a simple, two-snap pipeline: read data from an Azure DB, upsert data to Snowflake. When I specify all schema and table names, and the key columns in the upsert, everything works. Now I would like to use parameters. Pipeline Parameters Bulk Up...

Writing table to HTML page

Hi All, I am trying to write the data in the table to a html page, if can anyone suggest me how can i do it, that would be really helpful.

Resolved! Ability to read HTTP headers

Hi all, When you trigger a pipeline via a URL (as opposed to scheduled) is there a way to read the HTTP headers that were sent with the request? For example, I’d like to be able to read whether the method was GET or POST and I’d like to be able to de...

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Hello, I am trying to retrieve data from some of the Marketing Cloud’s Objects. Using the ClickEvent object; I am wondering if anyone has worked with Marketing Cloud. Currently I have the following set up and can obtain an access token but not able t...

Getting errors move large data to Snowflake

Hello, We are trying to move large amount of data from MS SQL to Snowflake using external staging, and getting following error. Too many S3 upload parts, maximum number of parts is 10000 Resolution: Increase the buffer size so that the file size divi...

Schedule Task to run every 5 min

Hi Team, I have a scheduled task for every 5 min. What happens if one execution is not completed with in 5 min. I have disabled the option “Do not start a new execution if one is already active”. Will it be in queue? or it will throw any exception. i...

Rollback deletion in case pipeline fails

We want to move data from one DB to another, and first step is to delete all the target data and then do insert. However in case of pipeline failure, we want to rollback to the original data in Target. Currently we are ending up with no data in targe...

SnapLogic - Integration Nation

Forum Posts

Parallel Reused Pipeline Executes Uneven Load

Snowflake Bulk Upsert not taking pipeline parameters

Writing table to HTML page

Resolved! Ability to read HTTP headers

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Getting errors move large data to Snowflake

Schedule Task to run every 5 min

Rollback deletion in case pipeline fails

Nest the document under another document

optional field on mapper

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...