Designing and Running Pipelines

Implied commit after oracle delete snap

I have a ETL pipeline. I want to do delete from table; insert into table; commit; but the oracle delete snap has a implied commit after it so I get delete; commit; insert; commit. My table is sitting there blank with no records until all the inse...

Default Names for Exported .slp files

Is there a way to change the default name for exported .slp files? It currently exports as pipeline name plus the date, but we want to change that to a standard prefix plus a the pipeline name. We don’t want users to need to update it at run time. Th...

Removing Null Values from JSON

Hi, We have a requirement to remove the null values elements from the json. Below is the example JSON which is having null values at Root and child levels. We need a solution to remove nulls at all levels and if all elements in child are removed then...

Getting Error streaming data while writing to a temporary file, reason=No space left on device

Using snowflake bulk load to load a big table. Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table. I have changed Buffer size from 10MB to 100MB but no luck. I am not sure what other settings ...

SnapLogic CI/CD with Exported slp files

I would like to build a CI/CD process that uses the exported slp files and compares them to the target environment and only overwrites them if there is a change. My original plan was to use the Metadata Snaps, but the “read” pulls a reference/pointer...

How to delete particular record from csv file

How to delete particular record from csv file eg. if the some record is processed from csv file then need to delete that record from csv file , please suggest how to proceed this. Thanks Mahes

Account Ref Functions in SnapLogic to refer credentials?

We have a requirement to pass credentials from external applications like centrify to our API calls. Instead of External, can i create a Snaplogic account and refer the password of that account using a ref function in the API call. In this case i can...

Create reusable lookup that we call multiple times in the same pipeline

We have requirement where we have multiple data quality rules configured in a Oracle table for each pipeline that loads different tables. Each rule also has a severity associated with it. Ex: If when are reading Employee data we want to check if Empl...

SnapLogic - Integration Nation

Forum Posts

Implied commit after oracle delete snap

Default Names for Exported .slp files

Removing Null Values from JSON

Getting Error streaming data while writing to a temporary file, reason=No space left on device

SnapLogic CI/CD with Exported slp files

How to delete particular record from csv file

Account Ref Functions in SnapLogic to refer credentials?

Create reusable lookup that we call multiple times in the same pipeline

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings