Designing and Running Pipelines

Writing file while performing batch processing

Hello Experts, I have a scenario where I have build a parent-child pipeline where the source has 50 records and the agenda is to process it in batch of 10, so the pipeline will run 5 times. The child contains a file writer which will create file in s...

Resolved! Throw exception on 0 documents

Hi All, Apologies if this one has been asked before. There is a scenario in the current pipeline being developed where after a filter operation the number of documents returned can be 0. at this point the pipeline completes as there is no further pro...

SalesForce - REST API with OAUTH2 Token Auto Refresh Issue

Hi, Is anyone using REST Get snap with Salesforce instance using OAUTH2 account? I am having trouble with keeping my Account tokens up to date. I am able to connect and receive an Access Token and a Refresh Token on my account using the Account “Refr...

Avoid Race Condition due to bulk upload

I have a pipeline with duplicate check logic in place which queries a endpoint and if no matching record is found then stores the file at the endpoint. My doubt is ,for a bulk upload call to this pipeline, will that duplicate check work or not. I und...

Resolved! How to pass parameter in JSON generator snap

Hello Community, Can you please help me to understand how can I pass or is it possible to pass parameter in JSON generator snap. Below snapshot for reference Please advise me to correct it

Resolved! Which snap to use to determine "match" or 'no match'

I have a task to design a pipeline to category response back from a API call. If the API tells me the result of “match” = , then I need to direct the data into a mongoDB collection; if the response tells me ‘match’ != empty, then I will mark it as “d...

Data goes null when updating CRM

I’m having an issue with a pipeline, and I’m hoping someone can help me with a solution The pipeline takes data from 2 different databases, and joins them, looks up from a third system, creates a new field, and thenupdates a field in CRM with that ne...

To delete a field

hi there, i have a simple json from which i am trying to delete field Attachements. sometimes it can come as array and sometimes not. please see my mapping in the attached pipeline. for somereason it complains the field doesnt exist. Any pointer on ...

SnapLogic - Integration Nation

Forum Posts

Writing file while performing batch processing

Resolved! Throw exception on 0 documents

SalesForce - REST API with OAUTH2 Token Auto Refresh Issue

Avoid Race Condition due to bulk upload

Resolved! How to pass parameter in JSON generator snap

Resolved! Which snap to use to determine "match" or 'no match'

Data goes null when updating CRM

To delete a field

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...