Designing and Running Pipelines

Removing Null Values from JSON

Hi, We have a requirement to remove the null values elements from the json. Below is the example JSON which is having null values at Root and child levels. We need a solution to remove nulls at all levels and if all elements in child are removed then...

Getting Error streaming data while writing to a temporary file, reason=No space left on device

Using snowflake bulk load to load a big table. Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table. I have changed Buffer size from 10MB to 100MB but no luck. I am not sure what other settings ...

SnapLogic CI/CD with Exported slp files

I would like to build a CI/CD process that uses the exported slp files and compares them to the target environment and only overwrites them if there is a change. My original plan was to use the Metadata Snaps, but the “read” pulls a reference/pointer...

How to delete particular record from csv file

How to delete particular record from csv file eg. if the some record is processed from csv file then need to delete that record from csv file , please suggest how to proceed this. Thanks Mahes

Account Ref Functions in SnapLogic to refer credentials?

We have a requirement to pass credentials from external applications like centrify to our API calls. Instead of External, can i create a Snaplogic account and refer the password of that account using a ref function in the API call. In this case i can...

Create reusable lookup that we call multiple times in the same pipeline

We have requirement where we have multiple data quality rules configured in a Oracle table for each pipeline that loads different tables. Each rule also has a severity associated with it. Ex: If when are reading Employee data we want to check if Empl...

Resolved! SQL Table into Excel File

I have a pipeline that I am working on that requires data to be extracted and transformed in SQL Server (completed) and should be loaded into a single excel file. I cant seem to get my data into an excel file. Has anyone completed a similar load, if ...

How to remove null value objects from json

Hello Team , can you please let me know how to remove null value objects . Below is the example Thanks in advance ! here is input – INPUT { "ESTDATA": { "TITLE": "Testing", "DESCRIPTION": "Testing Json", "VERSION": "", "CURRN": "", "TRANDS...

SnapLogic - Integration Nation

Forum Posts

Removing Null Values from JSON

Getting Error streaming data while writing to a temporary file, reason=No space left on device

SnapLogic CI/CD with Exported slp files

How to delete particular record from csv file

Account Ref Functions in SnapLogic to refer credentials?

Create reusable lookup that we call multiple times in the same pipeline

Resolved! SQL Table into Excel File

How to remove null value objects from json

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...