Designing and Running Pipelines

How to do a handshake with SNS Subsbription?

Hi, I’m trying to receive messages from AWS SNS subcription using URL of the ultra task. Can someone please help How to do a handshake with SNS Subscription the first time and handle the subsequent request? Also, where the Bearer token need to config...

Add prefix to each column

Hello Experts, for eg. if i have 50 columns and wanted to add some prefix to each column value then without mapping individual column in mapper how can i do it? Regards, Ajay

Using "Error Pipeline" - parent pipeline does not stop, how to stop it? error-pipeline called at the end?

Hi SL gurus! Pipeline got Error Pipeline defined in properties(for logging/alerting). When error occures, in e.g. Mapper, main pipeline does not stop and execute error-pipeline, but runs further. If more errors occur, they will be sent to the error-p...

Decrypt / Decode the content from incoming message from AWS SNS to ultra pipeline

I have received the below message from AWS SNS to my ultra pipeline, I would like to know how I can Decrypt / Decode the content from the message. Thanks [ { “task_name”: “xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx”, “client_port”: 19549, “x-amz-sns-topic-...

Performance with Triggered task

As part of our project requirement, we are using Triggered task and observed that performance is not as expected. So, can someone help to understand whether the trigger task has some latency in general to complete the transaction?

How to split the string on the basis of length of bytes

How can i Split string( UTF-8) on the basis of bytes length and not on the basis of character counts. e.g String > 4000 bytes then split the string into multiple columns each not more than 4000 bytes. Like, if string1 ~ 10,000 bytes then, first 4000 ...

Writing files to on-premise servers

I am trying to write a file that gets created in a pipeline to one of our on-premise servers (i.e. sftp://ourschool:22/directory/filename.txt) and am getting the following error message: Unable to create filesystem object for sftp://ourschool:22/dire...

Best practice for adding Subscribers to an AWS SNS topic

Apologies if this has already been covered, but I can’t find anything on the search. We need to add Subscribers to an AWS topic in bulk. The most basic use case of this will be a list of Subscribers and adding them via SnapLogic to an empty AWS SNS T...

SnapLogic - Integration Nation

Forum Posts

How to do a handshake with SNS Subsbription?

Add prefix to each column

Using "Error Pipeline" - parent pipeline does not stop, how to stop it? error-pipeline called at the end?

Decrypt / Decode the content from incoming message from AWS SNS to ultra pipeline

Performance with Triggered task

How to split the string on the basis of length of bytes

Writing files to on-premise servers

Best practice for adding Subscribers to an AWS SNS topic

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...