Designing and Running Pipelines

Passing Parameters to Digest MD5 function

Hi, I am trying to read data for multiple tables from SQL server using a parent-child pipeline combination. As part of the process I will also need to determine the CDC. Now i have to sort the data before I send to Diff snap or write my own Logic. As...

Bug for Autofill Target Path in Mapper

I want to be able to drag and drop all the columns in the input schema into the Target Path in Mapper. It works for the Expression though. Please see the video Autofill Target Attempt demonstrating the problem. I found Mapper autofill target path Sna...

Resolved! Convert CSV to required format

Hello All, I’m trying to Conver a CSV file to a JSON Format. Can anyone provide some inputs on how to achieve the required output format into a mapper? Required Format: { “values”: [ [ “Row1-Column1 Data”, “Row1-Column2 Data” ], [ “Row2-Column1 Data”...

Feedmaster queue pileup and the response time for ultra pipeline

Hi team, I am getting huge variation in the response time while processing request in ultra pipeline(sample pipe not much logic or processing). I have one ultra pipe running with multiple instances, and hitting 11000+ records to pipe from jmeter. Mos...

Unix Execute

I need to execute a shell script on a remote server. I’ve obtained the Unix Execute snap for that purpose but to configure the Unix Passwordless account I need to upload the .pem file to the snaplogic file repository. It feels a bit insecure to me an...

Writing Zip Files to S3

I am encountering some severe sluggishness in writing zip files to S3. When writing a 76 MB file, it takes 12 minutes to complete, versus 16 second when writing to a local destination. I think the problem is in transferring from ground to cloud. This...

Resolved! Group By Fields After Mapper / Structure

Hello all, I’m currently creating a pipeline which some basic distribution data for a document. Each of these has a foreign key ‘RevisionID’. I need to do multiple lookups on different tables to pull through and replace other foreign keys with the da...

account.property_map.settings.passPhrase.value: Missing property value

Hello Team, when i try to validate sftp path through directory browser snap,am getting below error. i’m using SSH account for validation Validation errors: account.property_map.settings.passPhrase.value: Missing property value Resolution: Please fix ...

SnapLogic - Integration Nation

Forum Posts

Passing Parameters to Digest MD5 function

Bug for Autofill Target Path in Mapper

Resolved! Convert CSV to required format

Feedmaster queue pileup and the response time for ultra pipeline

Unix Execute

Writing Zip Files to S3

Resolved! Group By Fields After Mapper / Structure

account.property_map.settings.passPhrase.value: Missing property value

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...