Designing and Running Pipelines

Unable to Connect AWS S3 Account

Hello All, I’m unable to connect the AWS S3 Account in spite of providing the correct tokens. Getting the below Error: Provided Permissions : actions = [ “s3:GetObject*”, “s3:PutObject*”, “s3:DeleteObject*”, “s3:List*”, “s3:GetBucketLocation”, ] Doe...

What is the purpose of the "Max in-flight" parameter in an ultra task?

The documentation description “to the maximum number of documents that can be processed by an instance at any one time” does not say a lot The default value is 200, but it is not clear if the task will shutdown after 200 documents, or if 200 document...

Load .xlxb workbook with multiple sheets to oracle table. Load only one or specific sheet data only

I have .xlsx file on remote server. My requirement is to load the file content into an oracle table. Any help is appreciable, Thanks in advance.

Traverse through an array

Hi, I have data in array format in two different streams , I want to check whether the array elements of the 1st stream are present in the 2nd stream or not. How should I do that? [“1001”,“1003”] [“1001”,“1002”,“1003”,“1004”] I have tried using ma...

Passing Parameters to Digest MD5 function

Hi, I am trying to read data for multiple tables from SQL server using a parent-child pipeline combination. As part of the process I will also need to determine the CDC. Now i have to sort the data before I send to Diff snap or write my own Logic. As...

Bug for Autofill Target Path in Mapper

I want to be able to drag and drop all the columns in the input schema into the Target Path in Mapper. It works for the Expression though. Please see the video Autofill Target Attempt demonstrating the problem. I found Mapper autofill target path Sna...

Resolved! Convert CSV to required format

Hello All, I’m trying to Conver a CSV file to a JSON Format. Can anyone provide some inputs on how to achieve the required output format into a mapper? Required Format: { “values”: [ [ “Row1-Column1 Data”, “Row1-Column2 Data” ], [ “Row2-Column1 Data”...

Feedmaster queue pileup and the response time for ultra pipeline

Hi team, I am getting huge variation in the response time while processing request in ultra pipeline(sample pipe not much logic or processing). I have one ultra pipe running with multiple instances, and hitting 11000+ records to pipe from jmeter. Mos...

SnapLogic - Integration Nation

Forum Posts

Unable to Connect AWS S3 Account

What is the purpose of the "Max in-flight" parameter in an ultra task?

Load .xlxb workbook with multiple sheets to oracle table. Load only one or specific sheet data only

Traverse through an array

Passing Parameters to Digest MD5 function

Bug for Autofill Target Path in Mapper

Resolved! Convert CSV to required format

Feedmaster queue pileup and the response time for ultra pipeline

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...