Designing and Running Pipelines

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Hello, I am trying to retrieve data from some of the Marketing Cloud’s Objects. Using the ClickEvent object; I am wondering if anyone has worked with Marketing Cloud. Currently I have the following set up and can obtain an access token but not able t...

Getting errors move large data to Snowflake

Hello, We are trying to move large amount of data from MS SQL to Snowflake using external staging, and getting following error. Too many S3 upload parts, maximum number of parts is 10000 Resolution: Increase the buffer size so that the file size divi...

Schedule Task to run every 5 min

Hi Team, I have a scheduled task for every 5 min. What happens if one execution is not completed with in 5 min. I have disabled the option “Do not start a new execution if one is already active”. Will it be in queue? or it will throw any exception. i...

Rollback deletion in case pipeline fails

We want to move data from one DB to another, and first step is to delete all the target data and then do insert. However in case of pipeline failure, we want to rollback to the original data in Target. Currently we are ending up with no data in targe...

Flattening multiple array entities in JSON Object

Hello, I am trying to flatten multiple array attributes from a JSON Document. Below is the JSON document and the expected output. { “TransactionId”: 55499, “ReceiptNo”: 1123, “Location”: “xxxx-xxxxx”, “Total”: 8.08, “TotalGross”: 7.46, “TransactionMe...

toString() is giving unexpected output

A field is coming as a number from source and we want to convert it to string, but the output format is different for some records. Follwoing 4 records have WSH value of 0 but after toString(), out is ‘0’ for 2 records and ‘0.0’ for the other 2

CSV Formatting issue

Hi I am getting json data in attached format from a JOIN Snap when viewed in table, I want to make one CSV out of it but it is taking only headers of the first json object screenshot of which is attached below. JSON form output Table form output Ne...

Implementation of OAuth 1.0

Hey Guys, so we have the following usecase: Talk to third party API that is protected by OAuth 1.0There is no out of the box support for this in Snap , so we need to built that custom logic in the pipeline custom logic is quite complex , and also in...

SnapLogic - Integration Nation

Forum Posts

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Getting errors move large data to Snowflake

Schedule Task to run every 5 min

Rollback deletion in case pipeline fails

Flattening multiple array entities in JSON Object

toString() is giving unexpected output

CSV Formatting issue

Implementation of OAuth 1.0

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...