Designing and Running Pipelines

Ultra pipelines snaplex setup questions

I have two quick questions around an Ultra pipelines setup: What is he minimum number of nodes needed for an ultra setup:Do we need 1 groundplex (feedmaster) and 1 groundplex (jcc)? Or is it 1 groundplex (feedmaster)?Assuming both a feedmaster and j...

Update STATE of the pipeline

Hi all, We’re planning to leverage publicly exposed Monitoring API to replay the failed messages (based on the State of the pipeline). The challenge we’re facing is, we’re not able to figure out how to update the STATE from ‘FAILED’ to ‘COMPLETED’. P...

How/Can you use Oracle DBMS_OUTPUT.PUT_LINE in a Oracle Stored Procedure snap

Currently, we use oracle’s DBMS_OUTPUT.PUT_LINE to log events that are happening in our PL/SQL packages. We are now migrating these PL/SQL packages so they can be executed using the Oracle Stored Procedure Snap. Where does the DBMS_OUTPUT data go whe...

Oracle Execute Snap Behavior when no data returned for a SQL Query

Hi All, While we are using Oracle Execute snap, we are unable to propagate ports / column names to next snaps like mapper where there is no data in source table which is resulting pipeline failure since column names are not propagated. To mitigate th...

Script snap with ultra pipelines: original property mapping to doc which is modified

Hi, I have a question regarding this statement from the SnapLogic documentation on Ultra Pipeline tasks (https://docs-snaplogic.atlassian.net/wiki/display/SD/Ultra+Pipeline+Tasks Script and Execute Script Snaps need you to pass the original document...

How to write each document to a file rather than all documents to a single file

I am reading multiple messages using JMS consumer into one big binary file then using a binary to document snap I am breaking it into multiple documents. How can I write each document to a separate file with timestamp rather than writing all the docu...

Create new object at end of array

I have a flat file shown here: “firstName”: “Gregor” “lastName”: “Samsa” “mainAddress”: “123 Main St” “mainCity”: “Boston” “mainState”: “MA” “mainZip”: “02131” “mailingAddress”: “456 Mailing Ave” “mailingCity”: “Somerville” “mailingState”: “MA” “mail...

Failing a pipeline that contains data in error view

Hi all, Is it possible to have a SnapLogic pipeline fail when one of the error views in the pipeline contains data, while still returning the output from the error views. In the example above, the pipeline contains multiple branches… and the SF Look...

SnapLogic - Integration Nation

Forum Posts

Ultra pipelines snaplex setup questions

Update STATE of the pipeline

How/Can you use Oracle DBMS_OUTPUT.PUT_LINE in a Oracle Stored Procedure snap

Oracle Execute Snap Behavior when no data returned for a SQL Query

Script snap with ultra pipelines: original property mapping to doc which is modified

How to write each document to a file rather than all documents to a single file

Create new object at end of array

Failing a pipeline that contains data in error view

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...