Designing and Running Pipelines

Add prefix to each column

Hello Experts, for eg. if i have 50 columns and wanted to add some prefix to each column value then without mapping individual column in mapper how can i do it? Regards, Ajay

Using "Error Pipeline" - parent pipeline does not stop, how to stop it? error-pipeline called at the end?

Hi SL gurus! Pipeline got Error Pipeline defined in properties(for logging/alerting). When error occures, in e.g. Mapper, main pipeline does not stop and execute error-pipeline, but runs further. If more errors occur, they will be sent to the error-p...

Decrypt / Decode the content from incoming message from AWS SNS to ultra pipeline

I have received the below message from AWS SNS to my ultra pipeline, I would like to know how I can Decrypt / Decode the content from the message. Thanks [ { “task_name”: “xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx”, “client_port”: 19549, “x-amz-sns-topic-...

Performance with Triggered task

As part of our project requirement, we are using Triggered task and observed that performance is not as expected. So, can someone help to understand whether the trigger task has some latency in general to complete the transaction?

How to split the string on the basis of length of bytes

How can i Split string( UTF-8) on the basis of bytes length and not on the basis of character counts. e.g String > 4000 bytes then split the string into multiple columns each not more than 4000 bytes. Like, if string1 ~ 10,000 bytes then, first 4000 ...

Writing files to on-premise servers

I am trying to write a file that gets created in a pipeline to one of our on-premise servers (i.e. sftp://ourschool:22/directory/filename.txt) and am getting the following error message: Unable to create filesystem object for sftp://ourschool:22/dire...

Best practice for adding Subscribers to an AWS SNS topic

Apologies if this has already been covered, but I can’t find anything on the search. We need to add Subscribers to an AWS topic in bulk. The most basic use case of this will be a list of Subscribers and adding them via SnapLogic to an empty AWS SNS T...

Pipeline Parameter in create statement

I have to pass the pipeline parameter as part of the table name in create table statement. Can you please share the syntax. Ex: “Create table “_jobname”+c1temp (abc , xyz …)” . it gives could not compile error…

SnapLogic - Integration Nation

Forum Posts

Add prefix to each column

Using "Error Pipeline" - parent pipeline does not stop, how to stop it? error-pipeline called at the end?

Decrypt / Decode the content from incoming message from AWS SNS to ultra pipeline

Performance with Triggered task

How to split the string on the basis of length of bytes

Writing files to on-premise servers

Best practice for adding Subscribers to an AWS SNS topic

Pipeline Parameter in create statement

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings