Designing and Running Pipelines

Using Python script with Unix snap

Hi Team, I want to run python scripts as it is running on external editor and read about unix snap can call the Python Script. Can you please let me know the steps and how can it is used to call the script. Can we upload it manually on server or do I...

Airflow scheduler for SnapLogic

Hello, Can any one help me on this for Snaplogic and Airflow Integration for scheduling the jobs. Appreciate your help. Thanks Sudheer

Increasing batch and fetch size in Oracle account

I am noticing some performance issues when processing larger volumes of data (10 million records) using the Oracle Bulk Loader in Snaplogic. I am able to compare the job as it runs in its current form (another integration tool) to Snaplogic and a j...

How to rename SFTP remote files?

I am in need some advices what to do when I want to rename the remote SFTP files after I downloaded them. For example, on the SFTP server, I have 3 files: test1.txt, test2.txt and test3.txt. I got my pipeline built to download all these 3 files. Afte...

Move/renaming files on SFTP server

I’m designing a pipeline to get a data file from an sftp server, use the data, and then rename the file to a filename with date and time and move it to an archive subfolder. I am attempting to use the pipeline from the showcase at: ...

Passing document from parent pipeline to child pipeline

Hi Team, I have a requirement to pass the document from parent pipeline to child pipeline, in child pipeline it has only one snap(Mapper Snap). Document which will be passing from parent pipeline should go as a input to mapper snap in child pipeline ...

Using Templates to drive Smartlink or JSON output

Has anyone figured out how to create Templates to drive the Target Schema in a mapper snap? This would be useful to standardize JSON output schema outputs and also reduce the time it takes to map outputs. If not can someone explain when and how a T...

Hold Rest Post Snap until all records uploaded

Hi, Below is my pipeline where iam trying to upload data from oracle execute query which returns 200k records. iam grouping them into 10k at a time to Rest Data Upload snap(rest post). My question - is there a way i can stay on Rest Data Upload snap ...

SnapLogic - Integration Nation

Forum Posts

Using Python script with Unix snap

Airflow scheduler for SnapLogic

Increasing batch and fetch size in Oracle account

How to rename SFTP remote files?

Move/renaming files on SFTP server

Passing document from parent pipeline to child pipeline

Using Templates to drive Smartlink or JSON output

Hold Rest Post Snap until all records uploaded

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...