Designing and Running Pipelines

How to divide dates in to custom quarters

I have a special quarter division requirement where I have to allot data to different quarters based on the dates they belong, for this I need to get the first Monday of each month, tried the below logic to get it but not working for the Monday part....

Resolved! Map Key value pairs function

Hi, I’m having it very difficult to fill the value of a key/value pair wit another value. I Have an object that consists of a list of strings that are each unique. but with each string inside the object there is a value outside the object for each it...

Resolved! Kafka consumer Skip messages when fail

Hi , We pull the data from Kafka and put it and the database, but we realized the Kafka consumer skips the data/offsets if the pipeline fails. for example: in a run Kafka consumer is supposed to read offset 3,4,5 but it pipeline fails so it skips the...

Resolved! Change the key to the value of the value of the key of a String For identifying columns

Hello, So I have a DataSet that looks like this: { Name : testvalue1, Name : testvalue2 } But I want to change the key ‘Name’ into the value it contains: output { testvalue1 : testvalue1, testvalue2 : testvalue2 } It’s needed because after that I w...

org.joda.time.LocalDateTime error for DB2 Insert

Hi, I had an issue with DateTime conversion issues Insert records when migrating data from MySQL to DB2. MYSQL dateformat : 2022-03-17 05:10:10 DB2 timeformat 2022/03/17 05:10:10 I am getting the following error Failure: SQL operation failed, Reason...

Extracting lineage from snapLogic pipelines

How can lineage–source information, target information, field transformations/calculations/derivations, etc.–be extracted from a group of pipelines? I need to be able to do so, to adhere to our company’s data governance rules around data movement. ...

Passing Body Content in Post Snap

Hi, This is a very novice question, but I am having trouble with a post request snap. This is just to authenticate with the RingCentral platform to receive a token for API consumption. I am able to successfully retrieve an access token when calling t...

To replace more than one character in string by looking up another field value

I have a business requirement, where we have below JSON in that, have to update object’s field called TRANSLATION_ID by looking up another fields called VARIABLE_ID and VARIABLE_VALUE. Here if both VARIABLE_ID and VARIABLE_VALUE are not null then rep...

SnapLogic - Integration Nation

Forum Posts

How to divide dates in to custom quarters

Resolved! Map Key value pairs function

Resolved! Kafka consumer Skip messages when fail

Resolved! Change the key to the value of the value of the key of a String For identifying columns

org.joda.time.LocalDateTime error for DB2 Insert

Extracting lineage from snapLogic pipelines

Passing Body Content in Post Snap

To replace more than one character in string by looking up another field value

Data Validator Pattern error

Deleting multiple files at once from SFTP folder

SQS -pipeline stalling

Best Approach for Handling CSV Import with Truncat...

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3