Designing and Running Pipelines

How to log the rejected records while migrating the data

Hi , We have migrated the data from DB2 to MySQL AWS cloud. For 1 table there were duplicaate records in DB2 as there were no primary keys or index keys deifned. But we have set composite keys in cloud DB. While migrating the duplicate records were ...

Bidirectional data sync (Two way data Sync between the databases)

Hi , we are migrating applications from DB2 to Azure SQL. I have a situation where I need to sync tables data in both ways DB2 to Azure SQL and AZure SQL to DB2. The tables doesnt have any timestamp fields (created or updated). Is there anyway we cou...

Resolved! URL Pagination, but it's buried within the string

This article is very similar to my question. I’m in a bit of a different boat though. My pagination is buried as a string within a string within the headers - not entity. I am able to parse with something like $headers.link.split(“;”)[1] but this se...

Rest Post a File

Hi, I have pipeline with Rest POST snap and post CSV Binary content, instead of load file from SLDB. Can you share if any solution ? Thanks in advance Satish

Group by fields snap and sort snap on huge data

Hello, The usecase of my solution is to get the data from oracle db and group by 4 fields (FLOWTYPE_ID$ ,PRODAT_ORIGINE,SACC_ID$,BAL) or records satisfying combination of 4 fields (FLOWTYPE_ID$ ,PRODAT_ORIGINE,SACC_ID$,BAL) are sent to same file and ...

Parsing error data from error view

Dear community, I am trying to insert data via API. When that data exists, the response will return status code 400 and I need to parse the error message to get the id of the record that exists on the API. This is a child pipeline and has also been s...

TRIM spaces for DB2 select

Hi, we are migrating DB2 tables into AWS Aurora MySQL database. I am using Generic JDBC select SNAP to select the data from the DB2 database .we had an issue with data migration for the DB2 char fields . The Char fields selected from DB2 has the trai...

Resolved! Row to comma-separated conversion

Hi There, I need some help in converting the row-wise data to comma-separated. I provide sample data below. Here the values are combined together based on the unique cust_id. Thanks

SnapLogic - Integration Nation

Forum Posts

How to log the rejected records while migrating the data

Bidirectional data sync (Two way data Sync between the databases)

Resolved! URL Pagination, but it's buried within the string

Rest Post a File

Group by fields snap and sort snap on huge data

Parsing error data from error view

TRIM spaces for DB2 select

Resolved! Row to comma-separated conversion

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...