Designing and Running Pipelines

MS-Access Connection

I am trying to access the MS-access file from S3 location. But when i am trying to access i am getting the below error message. i suspect there is something wrong only on the JDBC URL from the Generic Database Account connection. Below is my URL. JDB...

How to get failure records in a run time during batch process

I have small requirement , have pipeline which will copy the data from cloud through batches ,during batch processing some of records are faulty records those needs to be captured and re-processing again . How can I provide log the faulty records and...

Slowness in Ultra Task Enable

Hi, Once the Ultra is enabled in manager. The process takes sufficient time (10 Min sometimes) to show the ultra in the Dashboard. Once the Ultra is visible and when invoked to run the process, it fails with " 504Gateway Time-out" Any reason for this...

Download Snaplogic Pipelines and Tasks List

Hi, We are trying to consolidate a list of our pipelines and tasks. Is there a way to download this from Snaplogic? Like from a repository or database? Has anyone done this in the past? Thanks, David

How to use Deduplicate snap?

I plan to use Deduplicate snap to remove duplicate records from a CSV file. In my CSV file, let’s say I have 3 records with the same ID. I just want to keep 1 record. So I am using Deduplicate snap and set it up like this It works but it also remove...

Different parameter for Pipeline Validation vs Execute Pipeline

Hi, Is there a way to define default values (parameters, mapper, elsewhere) based on the run mode of the pipeline? During pipeline development I wish for some parameter to default to X during validation runs, but have it default to Y during Execution...

Reference pipeline properties from python in a Script Snap

I’d like to be able to reference pipe.projectPath in a python script, in a Script Snap? Is this possible?..what is the syntax?

How to read and delete specific AWS SQS message in snaplogic

Hi, We have a requirement to read specific SQS message (by passing sqs message id) and delete it after entire pipeline process gets completed. When I use the SQS Consumer snap by passing sqs message id, it is reading all the messages from Queue inst...

SnapLogic - Integration Nation

Forum Posts

MS-Access Connection

How to get failure records in a run time during batch process

Slowness in Ultra Task Enable

Download Snaplogic Pipelines and Tasks List

How to use Deduplicate snap?

Different parameter for Pipeline Validation vs Execute Pipeline

Reference pipeline properties from python in a Script Snap

How to read and delete specific AWS SQS message in snaplogic

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...