Designing and Running Pipelines

Resolved! Discard all documents in pipeline

At the very end of a pipeline I would like to update a single row in a logging table. I’m going to do that in an Execute Task snap, but the problem I’m having is that it wants to run the child snap 20k times instead of simply running a single update ...

Pass parameter from child pipeline to parent pipeline

I have a parent pipeline that executes a child pipeline. The child pipeline’s sole purpose to write a single row to a logging table. After writing to the logging table, the child pipeline runs a Select Snap to get the newly inserted log_id. My questi...

Convert an existing groundplex to support ultra pipeline execution

Hello Community, we currently have a Groundplex consisting of 2 nodes. We have use cases that require ultra pipelines. The questions are: Can we extend the existing groundplex to support ultra pipelines? Is this possible by adding at least one feedma...

Snowflake Bulk Load

Hi, I am trying to use Snowflake bulk load snap to read data from external S3 location and load into the snowflake table. here the challenge is that. Under the Snowflake account, I have mentioned the external bucket name and provided keys. but when a...

Resolved! Simple document viewer during testing

I was wondering if there is a simple way of viewing documents made it down a certain path during testing of a pipeline. I know that I can view how many documents flow in and out of a Snap using the statistics viewer, but I’d like to actually see the ...

Resolved! Router snap catch all

I have a section in a pipeline where I need to route documents down one of two paths. I would like to do a single comparison on some fields, if it’s true go down one path, if it’s not, go down another path. Think of it as the ELSE in a SWITCH stateme...

Resolved! Converting Array to Comma Separated String

I have JSON output from a Salesforce SOQL snap, in the format [ { “QualifiedApiName”: “Accelerator_Pack__c” }, { “QualifiedApiName”: “Access_Certifications__c” }, { “QualifiedApiName”: “Access_Requests__c” }, { “QualifiedApiName”: “Account_Cleansed__...

Mapper Expression for PostgreSQL into bit type

I have a target table that is in PostgreSQL. I have a field in that table that is of type bit. I have a mapper before an INSERT PostgreSQL Snap type. I’m trying to use an expression to map to the bit field type but everything I try has a type mismatc...

SnapLogic - Integration Nation

Forum Posts

Resolved! Discard all documents in pipeline

Pass parameter from child pipeline to parent pipeline

Convert an existing groundplex to support ultra pipeline execution

Snowflake Bulk Load

Resolved! Simple document viewer during testing

Resolved! Router snap catch all

Resolved! Converting Array to Comma Separated String

Mapper Expression for PostgreSQL into bit type

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...