Designing and Running Pipelines

Traverse through an array

Hi, I have data in array format in two different streams , I want to check whether the array elements of the 1st stream are present in the 2nd stream or not. How should I do that? [“1001”,“1003”] [“1001”,“1002”,“1003”,“1004”] I have tried using ma...

Passing Parameters to Digest MD5 function

Hi, I am trying to read data for multiple tables from SQL server using a parent-child pipeline combination. As part of the process I will also need to determine the CDC. Now i have to sort the data before I send to Diff snap or write my own Logic. As...

Bug for Autofill Target Path in Mapper

I want to be able to drag and drop all the columns in the input schema into the Target Path in Mapper. It works for the Expression though. Please see the video Autofill Target Attempt demonstrating the problem. I found Mapper autofill target path Sna...

Resolved! Convert CSV to required format

Hello All, I’m trying to Conver a CSV file to a JSON Format. Can anyone provide some inputs on how to achieve the required output format into a mapper? Required Format: { “values”: [ [ “Row1-Column1 Data”, “Row1-Column2 Data” ], [ “Row2-Column1 Data”...

Feedmaster queue pileup and the response time for ultra pipeline

Hi team, I am getting huge variation in the response time while processing request in ultra pipeline(sample pipe not much logic or processing). I have one ultra pipe running with multiple instances, and hitting 11000+ records to pipe from jmeter. Mos...

Unix Execute

I need to execute a shell script on a remote server. I’ve obtained the Unix Execute snap for that purpose but to configure the Unix Passwordless account I need to upload the .pem file to the snaplogic file repository. It feels a bit insecure to me an...

Writing Zip Files to S3

I am encountering some severe sluggishness in writing zip files to S3. When writing a 76 MB file, it takes 12 minutes to complete, versus 16 second when writing to a local destination. I think the problem is in transferring from ground to cloud. This...

Resolved! Group By Fields After Mapper / Structure

Hello all, I’m currently creating a pipeline which some basic distribution data for a document. Each of these has a foreign key ‘RevisionID’. I need to do multiple lookups on different tables to pull through and replace other foreign keys with the da...

SnapLogic - Integration Nation

Forum Posts

Traverse through an array

Passing Parameters to Digest MD5 function

Bug for Autofill Target Path in Mapper

Resolved! Convert CSV to required format

Feedmaster queue pileup and the response time for ultra pipeline

Unix Execute

Writing Zip Files to S3

Resolved! Group By Fields After Mapper / Structure

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...

Best way to perform multiple search and replace in...

Obtain Rest API curl to run in postman directly

CSV parser cannot parse data

Parsing XML using a Python script returns an encod...

multiple array objects

String replace method where pattern is dynamic