Designing and Running Pipelines

Identifying when a Control Break occurs in a pipeline

Have you ever needed to identify when a control break occurs in your incoming data? Having this ability can save you considerable processing resources in cases where your incoming data is sorted on last names and you only need to perform calculations...

Complex XML Processing & HR Onboarding/Off-Boarding with Workday

This pipeline illustrates two of our commonly encountered customer scenarios: a) An example of complex XML processing, and b) A real world example of what HR On-Boarding/Off-boarding might look like with Workday data I have used variants of this pipe...

Useful Third Party Utilities

None of these tools are “official” or truly supported. If it breaks, you get to keep the pieces. Disclaimer aside: I need help writing JSON Path Expressions First, re-evaluate why you are writing a JSON Path Expression. Try using a mapper, or severa...

Connect to local database to test Snaplogic pipelines

This example uses MySQL installed on developer’s laptop Install MySql DB on you local machineLogin to you ISP’s routerEnable port forwarding fro the specific port - (the default for MySQL is 3306)Login to SnaplogicCreate a MySQL account and Fill in ...

Aggregation of IDs for IN clause in a Delete DB Snap

When a Database Delete (Example: SQL Server Delete) snap is used, the snap goes through each of the entries in the incoming document and makes one roundtrip to the database to delete the pertinent record. Whilst it could be argued that this is not th...

Restaurants bill software

This is an experiment pipeline to generate the Restaurant’s bill according to the ordered items vs menu. Here’s the image of the pipeline and attached is the pipeline. Restaurants bill software_2017_02_18.slp (16.7 KB)

Configuring SnapLogic Hive Account for Hive on HortonWorks HDP (No Kerberos)

Below are steps to configure the Hive Account in SnapLogic to connect to a Hive Database on HortonWorks Step 1: Go to Product Downloads | Cloudera and download the HortonWorks JDBC Driver for Apache Hive Step 2: If Kerberos is not enabled on HortonWo...

Ultra Pipeline blogs

Please click on the links below to learn about the Ultra Pipeline Tasks (Blog posts) Designing Ultra Pipelines Designing Ultra Pipelines: Types of Views Designing Ultra Pipelines: Error and Exception Handling Ultra Pipelines: Performance, Management ...

SnapLogic - Integration Nation

Forum Posts

Identifying when a Control Break occurs in a pipeline

Complex XML Processing & HR Onboarding/Off-Boarding with Workday

Useful Third Party Utilities

Connect to local database to test Snaplogic pipelines

Aggregation of IDs for IN clause in a Delete DB Snap

Restaurants bill software

Configuring SnapLogic Hive Account for Hive on HortonWorks HDP (No Kerberos)

Ultra Pipeline blogs

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...