Designing and Running Pipelines

Extracting the runid of the pipeline

I am trying to extract the unique ID (generated at the run time) and assign it to a variable so that I can push it my Audit Db(external) I am using the pipe.ruuid for that. I am able to get the information for each transaction. In case of failures I ...

Pipelines taking time to stop

Hi, After the last update, when I stop the pipeline. it takes couple of minutes before pipeline completely stops and the status is “Stopping”. During this status pipeline process the data which is unexpected. Anyone had similar issues? Any work aroun...

Merging output of one document in next

I am working on a pipeline where I am reading data from CSV generator. I have 2 types of data H line and I line for each one I need to do some mapping, which is fine. the final output I need to sent to SAP with a format H + I So I need to merge the H...

Pipeline Scheduling

Hi, I have scheduled my ETL Pipeline using Snaplogic Manager and this is set as cron. This ETL Pipeline runs everyday (Mon - Sun) at 6 hour intervals i.e. 2 AM,8 AM, 2 PM and 8 PM. I want to skip the run on Monday at 2 PM. I didn’t find a way to do ...

Increase Pipeline Throughput By Parallelizing Service Calls

Many times when designing a pipeline for a use case one may need to make a call to an external service (REST/SOAP). In SnapLogic REST and SOAP snaps operate serially, meaning they can only process one document at a time. Some service calls may take a...

Is XML Parser _very_ strict?

Hi folks, I was looking to expose a Task via URL trigger with a payload of an XML message, so i started mocking this up with a sample XML as a file in SLFS and a simple pipeline File Reader → XML Parser → do-stuff. I didnt specify the “Inbound schema...

RabbitMQ Acknoweldge

Hi, Similar to JMS. How can I do client acknowledgement for RabbitMQ? Thanks !

Execution time on non-execution route with router

Hi, We have a router with below conditions if input==true, then output 1 if input==false, then output 2 Lets say my input is false… so the snaps connected to router output2 will be fired and running. However I found that at the sametime, the snaps co...

SnapLogic - Integration Nation

Forum Posts

Extracting the runid of the pipeline

Pipelines taking time to stop

Merging output of one document in next

Pipeline Scheduling

Increase Pipeline Throughput By Parallelizing Service Calls

Is XML Parser _very_ strict?

RabbitMQ Acknoweldge

Execution time on non-execution route with router

split target csv file into more smaller CSV's

How can I edit/update my community posts?

Http Client Snap vs REST Post snap

Parsing CSV file

Data Validator Pattern error

Deleting multiple files at once from SFTP folder

SQS -pipeline stalling

Best Approach for Handling CSV Import with Truncat...

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...