Designing and Running Pipelines

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Hello, I am trying to retrieve data from some of the Marketing Cloud’s Objects. Using the ClickEvent object; I am wondering if anyone has worked with Marketing Cloud. Currently I have the following set up and can obtain an access token but not able t...

Getting errors move large data to Snowflake

Hello, We are trying to move large amount of data from MS SQL to Snowflake using external staging, and getting following error. Too many S3 upload parts, maximum number of parts is 10000 Resolution: Increase the buffer size so that the file size divi...

Schedule Task to run every 5 min

Hi Team, I have a scheduled task for every 5 min. What happens if one execution is not completed with in 5 min. I have disabled the option “Do not start a new execution if one is already active”. Will it be in queue? or it will throw any exception. i...

Rollback deletion in case pipeline fails

We want to move data from one DB to another, and first step is to delete all the target data and then do insert. However in case of pipeline failure, we want to rollback to the original data in Target. Currently we are ending up with no data in targe...

Flattening multiple array entities in JSON Object

Hello, I am trying to flatten multiple array attributes from a JSON Document. Below is the JSON document and the expected output. { “TransactionId”: 55499, “ReceiptNo”: 1123, “Location”: “xxxx-xxxxx”, “Total”: 8.08, “TotalGross”: 7.46, “TransactionMe...

toString() is giving unexpected output

A field is coming as a number from source and we want to convert it to string, but the output format is different for some records. Follwoing 4 records have WSH value of 0 but after toString(), out is ‘0’ for 2 records and ‘0.0’ for the other 2

CSV Formatting issue

Hi I am getting json data in attached format from a JOIN Snap when viewed in table, I want to make one CSV out of it but it is taking only headers of the first json object screenshot of which is attached below. JSON form output Table form output Ne...

Implementation of OAuth 1.0

Hey Guys, so we have the following usecase: Talk to third party API that is protected by OAuth 1.0There is no out of the box support for this in Snap , so we need to built that custom logic in the pipeline custom logic is quite complex , and also in...

SnapLogic - Integration Nation

Forum Posts

Resolved! Using SOAP UI to pull SalesForce's Marketing Cloud ClickEvent

Getting errors move large data to Snowflake

Schedule Task to run every 5 min

Rollback deletion in case pipeline fails

Flattening multiple array entities in JSON Object

toString() is giving unexpected output

CSV Formatting issue

Implementation of OAuth 1.0

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings