Designing and Running Pipelines

Increasing batch and fetch size in Oracle account

I am noticing some performance issues when processing larger volumes of data (10 million records) using the Oracle Bulk Loader in Snaplogic. I am able to compare the job as it runs in its current form (another integration tool) to Snaplogic and a j...

How to rename SFTP remote files?

I am in need some advices what to do when I want to rename the remote SFTP files after I downloaded them. For example, on the SFTP server, I have 3 files: test1.txt, test2.txt and test3.txt. I got my pipeline built to download all these 3 files. Afte...

Move/renaming files on SFTP server

I’m designing a pipeline to get a data file from an sftp server, use the data, and then rename the file to a filename with date and time and move it to an archive subfolder. I am attempting to use the pipeline from the showcase at: ...

Passing document from parent pipeline to child pipeline

Hi Team, I have a requirement to pass the document from parent pipeline to child pipeline, in child pipeline it has only one snap(Mapper Snap). Document which will be passing from parent pipeline should go as a input to mapper snap in child pipeline ...

Using Templates to drive Smartlink or JSON output

Has anyone figured out how to create Templates to drive the Target Schema in a mapper snap? This would be useful to standardize JSON output schema outputs and also reduce the time it takes to map outputs. If not can someone explain when and how a T...

Hold Rest Post Snap until all records uploaded

Hi, Below is my pipeline where iam trying to upload data from oracle execute query which returns 200k records. iam grouping them into 10k at a time to Rest Data Upload snap(rest post). My question - is there a way i can stay on Rest Data Upload snap ...

Parse Excel file with duplicate columns

Hi All, I have same column name multiple times in excel file. I want to parse all and load them into database but excel parser throws error of duplicate columns. Please suggest. Thanks

Reading Source file and target file and mapping data from source file to target file

Hi All, We have a requirement to read the data from source file and map it to target file where as the target file has to be taken as input file to read the structure(target columns) as target file structure is dynamic. Ex: Source File has columns A ...

SnapLogic - Integration Nation

Forum Posts

Increasing batch and fetch size in Oracle account

How to rename SFTP remote files?

Move/renaming files on SFTP server

Passing document from parent pipeline to child pipeline

Using Templates to drive Smartlink or JSON output

Hold Rest Post Snap until all records uploaded

Parse Excel file with duplicate columns

Reading Source file and target file and mapping data from source file to target file

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...

Best way to perform multiple search and replace in...

Obtain Rest API curl to run in postman directly

CSV parser cannot parse data

Parsing XML using a Python script returns an encod...

multiple array objects

String replace method where pattern is dynamic