Designing and Running Pipelines

Implied commit after oracle delete snap

I have a ETL pipeline. I want to do delete from table; insert into table; commit; but the oracle delete snap has a implied commit after it so I get delete; commit; insert; commit. My table is sitting there blank with no records until all the inse...

Default Names for Exported .slp files

Is there a way to change the default name for exported .slp files? It currently exports as pipeline name plus the date, but we want to change that to a standard prefix plus a the pipeline name. We don’t want users to need to update it at run time. Th...

Removing Null Values from JSON

Hi, We have a requirement to remove the null values elements from the json. Below is the example JSON which is having null values at Root and child levels. We need a solution to remove nulls at all levels and if all elements in child are removed then...

Getting Error streaming data while writing to a temporary file, reason=No space left on device

Using snowflake bulk load to load a big table. Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table. I have changed Buffer size from 10MB to 100MB but no luck. I am not sure what other settings ...

SnapLogic CI/CD with Exported slp files

I would like to build a CI/CD process that uses the exported slp files and compares them to the target environment and only overwrites them if there is a change. My original plan was to use the Metadata Snaps, but the “read” pulls a reference/pointer...

How to delete particular record from csv file

How to delete particular record from csv file eg. if the some record is processed from csv file then need to delete that record from csv file , please suggest how to proceed this. Thanks Mahes

Account Ref Functions in SnapLogic to refer credentials?

We have a requirement to pass credentials from external applications like centrify to our API calls. Instead of External, can i create a Snaplogic account and refer the password of that account using a ref function in the API call. In this case i can...

Create reusable lookup that we call multiple times in the same pipeline

We have requirement where we have multiple data quality rules configured in a Oracle table for each pipeline that loads different tables. Each rule also has a severity associated with it. Ex: If when are reading Employee data we want to check if Empl...

SnapLogic - Integration Nation

Forum Posts

Implied commit after oracle delete snap

Default Names for Exported .slp files

Removing Null Values from JSON

Getting Error streaming data while writing to a temporary file, reason=No space left on device

SnapLogic CI/CD with Exported slp files

How to delete particular record from csv file

Account Ref Functions in SnapLogic to refer credentials?

Create reusable lookup that we call multiple times in the same pipeline

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...