Designing and Running Pipelines

Thoughts on Decoupled Batch Process Involving Ultra Pipelines

I have a “batch” process today, where a parent pipeline pulls a list of items (1000s) from some application’s REST API, and executes (pipeline execute) children pipelines for each which work the individual items. Each child process consists of downl...

Kafka Consumer Snap

Hi I wanted to read all the records from the kafka queue in first run and then latest records from the queue from kafka consumer snap.I start reading for the first time from the queue,what setting of ‘seek type’ and ‘auto offset reset’ should I use i...

String to Char Array

Good Day Everyone, How do you convert a string datatype to a char Array datatype in order to do a SQL Server Lookup where the field being searched is of char(10) format? The data being entered is of string format eg. “A345”. However this error is ret...

Dataware housing ID generation process needed suggestion

Hi Experts, We are trying to build data warehouse via snaplogic. Whenever there is same record pulled from source (Big data system) we should have same ID generated and when there is new record then new id has to be generated. Since this is decommiss...

Resolved! How to generate dynamic file name by using pipeline execute

We’re using pipeline execute to run the tasks in parallel by check Reuse executions to process documents and changed Pool Size. But in the pipeline execute called pipeline, it will generate a log file as an output. How do we generate different file n...

Resolved! Convert Rows to Columns

I’m trying to convert row values into columns. Can anyone suggest me how should I approach to resolve this?

Question: Unable to pass Schema and table name as Parameters to Select Snaps

When passing the Schema name as parameter, I can see the value in preview but snap is complaining that it is null.

Viewing SQL generated by a Snap

Is there a way I can view the exact SQL that is generated by a pipeline? I am debugging a pipeline that uses the Oracle - Execute snap. The results from the generated SQL are not what I am expected and I would like to be able to see what statement i...

SnapLogic - Integration Nation

Forum Posts

Thoughts on Decoupled Batch Process Involving Ultra Pipelines

Kafka Consumer Snap

String to Char Array

Dataware housing ID generation process needed suggestion

Resolved! How to generate dynamic file name by using pipeline execute

Resolved! Convert Rows to Columns

Question: Unable to pass Schema and table name as Parameters to Select Snaps

Viewing SQL generated by a Snap

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings