Designing and Running Pipelines

Union for Error and for Success

Hi all, I am trying to develop a pipeline with Union where the unions is only satisfied when ALL branches are successful. Any error in the branch should not satisfy the Union and should trigger the error pipeline. Current behavior is that the union i...

Reading an http file in csv format

I want to read this csv file “http://api.pluralsight.com/api-v0.9/courses” into a snap When I used mapper and file reader, I obtained this error message: Failure: Unable to read from http://api.pluralsight.com/api-v0.9/courses, Reason: The file can n...

Update statement in Oracle excute for JSON format

Hi, I have an requirement to save the JSON column value in an Oracle DB. I am trying to use Oracle execute to design Update statement. I am using below syntax, but it is throwing error. I think did we need to extra cautious to handle single quote and...

Formatting JSON data according to given scenarios

Hi, I need to know the ways of performing the restructuring of the JSON payload based on the requirement.for ex. quiz_id value we need to distribute to each type of question. below are input and expected output need to achieve through snaplogic pipel...

Extracting a large data set

Hi community, I hope everyone is keeping safe. I have a request to design a data pipeline to extract ~100M rows of data, with about 10 columns in the table. What’s the best practice approach to carrying this out? The source system is a DB2 database, ...

Count of successful rows from Oracle Merge

Hi, I have a requirement to record the successful row count from Oracle Merge Snap. this is to maintain the Data Log table. Is there any way to know the successful rows from Oracle Merge. i saw something in Mapper (snap.out.totalCount). Please someon...

Resolved! Getting the Status from a REST call

Hi Folks, I’m having trouble getting a proper handling from Snaplogic on a REST call. So the rest call will return on success: “entity”: { “MessageId”:“0101017165ec422f-dfa2bb38-faac-4c48-bcd7-0e2869d80fb6-000000”, …} And on Error: “entity”: "ERROR: ...

Parquet Writer

Hi I was trying to use parquet writer to write file into S3 folder - where i was unable to do it as it is throwing an error. I tried with other files where i could successfully write into S3. Kindly help me. It says that invalid path or aws account b...

SnapLogic - Integration Nation

Forum Posts

Union for Error and for Success

Reading an http file in csv format

Update statement in Oracle excute for JSON format

Formatting JSON data according to given scenarios

Extracting a large data set

Count of successful rows from Oracle Merge

Resolved! Getting the Status from a REST call

Parquet Writer

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...