Designing and Running Pipelines

Convert array to object and remove empty array

Hello experts, Can you help me on converting array to object. Input :- { “abc”: [ { “ex_1_filed_name”: “a”, “ex_1_filed_Value”: “N” }, { “ex_1_filed_name”: “b”, “ex_1_filed_value”: “Y” }, [ { “ex_1_filed_name”: “c”, “ex_1_filed_value”: “d”, “valuid”:...

Loading Null values into Snowflake DB via Bulk Load Snap

Hey All, So I’m trying to load certain columns from a csv file into snowflake, but facing some issues. I have the file, properly parsed it via the csv parser, and I’ve also used a mapper to map the columns properly. However, I need snaplogic to be ab...

Rest Get Snaps with Pagination getting partial data

Has anyone encounter REST API Get that retrieves partial data half of the time when using pagination? Against the same data, my pipeline gets different results every time it executes, it seems like its not going to the next page on some of the execut...

Implied commit after oracle delete snap

I have a ETL pipeline. I want to do delete from table; insert into table; commit; but the oracle delete snap has a implied commit after it so I get delete; commit; insert; commit. My table is sitting there blank with no records until all the inse...

Default Names for Exported .slp files

Is there a way to change the default name for exported .slp files? It currently exports as pipeline name plus the date, but we want to change that to a standard prefix plus a the pipeline name. We don’t want users to need to update it at run time. Th...

Removing Null Values from JSON

Hi, We have a requirement to remove the null values elements from the json. Below is the example JSON which is having null values at Root and child levels. We need a solution to remove nulls at all levels and if all elements in child are removed then...

Getting Error streaming data while writing to a temporary file, reason=No space left on device

Using snowflake bulk load to load a big table. Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table. I have changed Buffer size from 10MB to 100MB but no luck. I am not sure what other settings ...

SnapLogic CI/CD with Exported slp files

I would like to build a CI/CD process that uses the exported slp files and compares them to the target environment and only overwrites them if there is a change. My original plan was to use the Metadata Snaps, but the “read” pulls a reference/pointer...

SnapLogic - Integration Nation

Forum Posts

Convert array to object and remove empty array

Loading Null values into Snowflake DB via Bulk Load Snap

Rest Get Snaps with Pagination getting partial data

Implied commit after oracle delete snap

Default Names for Exported .slp files

Removing Null Values from JSON

Getting Error streaming data while writing to a temporary file, reason=No space left on device

SnapLogic CI/CD with Exported slp files

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...