Designing and Running Pipelines

Zip Snap file structure

I have a pipeline which reads data from an S3 location and writes to an SMB location with no transformations. The pipeline involves 2 main snaps, S3 reader connected to Zip write snap. The Zip write snap recreates the whole structure of the S3 locati...

Limit the number of pipelines running on a node at a time

Is there an option in Snaplex to limit the number of running pipelines? I currently only see an option to limit the number of Snaps but with multiple different pipelines running, this would not be ideal plus I believe it’s strictly for manual runs an...

Combining all records in one single JSON

Hi Team, I have below input [ { "parents": "A", "value": "1" }, { "parents": "B", "value": "2" }, { "parents": "C", "value": "3" }, { "parents": "D", "value": "4" } ] When i tried using the expression ...

String to Object

Hi All, KIndly help to get below output "entity": [ { "tenantId": "tv", "type": "rdm/lookupTypes/FAMILY_TYPE", "code": "Delivery Assurance", "enabled": true, "parents": [ "rdm/lookupTypes/FAMILY...

XML Generator, Entity referenced, but not declared

I’m having trouble using the XML Generator with data that contains special symbols and characters. All the usual suspects (<, >, &, ", ', ) have been taken care of by using the HTML notations <, >, &amp, etc., but I’m having trouble with others that ...

How to Convert Object with Key Values Pairs to Array of key values Pairs

This issue I face a lot of times and there is no simple solution I have found so far, let me know if anyone is able to do it Input: { "quotes":{ "USDAED":3.673325, "USDAFN":63.849999, "USDALL":124.388, "USDAMD":476.287499,...

Salesforce Bulk Upsert Authorization

Hello, I cannot get my Salesforce Bulk Upsert snap to authorize initially. How do I get the initial token?

Sort snap not competing even after 24 hrs

Hi Team, I had a requirement where I have to use a sort snap and this sort needs to sort 50000 documents. But after processing 3057 documents, this snap kind of stuck keeps on validating but not processing the next documents. It’s running for 24 hour...

SnapLogic - Integration Nation

Forum Posts

Zip Snap file structure

Limit the number of pipelines running on a node at a time

Combining all records in one single JSON

String to Object

XML Generator, Entity referenced, but not declared

How to Convert Object with Key Values Pairs to Array of key values Pairs

Salesforce Bulk Upsert Authorization

Sort snap not competing even after 24 hrs

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...