Designing and Running Pipelines
Discuss how to use the SnapLogic platform.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Replace a single key in a json object

Hi All, I want to replace just one keyname with another name. For example: initial input : { “Field1”: “bar”, “Field2”: “bar” } desired output : { “NEWNAME”: “bar”, “Field2”: “bar” } I checked the docs and saw that we can use $.mapKeys to play with t...

abjoe by New Contributor II
  • 5022 Views
  • 3 replies
  • 0 kudos

Filereader fails

When I read the file it gets the error below. It happens sporadically, I noticed on the 1st try after a couple of hours being idle. The pipeline has been working for the last 3 months and error began a week a go. When tried again it now will work. Th...

maguilar by New Contributor
  • 1496 Views
  • 0 replies
  • 0 kudos

Pipeline execution in series

Hi, I have to execute two pipelines in series, currently using two pipeline execute snaps connected to each other, when I execute the pipeline these pipeline execute snap will execute both child pipeline parallely. Please could you suggest the option...

Hemanth by New Contributor
  • 5387 Views
  • 6 replies
  • 0 kudos

KERBEROS issues - HDFS cluster

Hi , We’ve implemented Kerberos in our hadoop cluster, but we are having issues with our pipelines. We are getting this error "Reason: org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN, KERBER...

Petrica by New Contributor II
  • 4834 Views
  • 3 replies
  • 0 kudos

Kafka Consumer Crash

Hi All, If I am using a Confluent Kafka Consumer Snap and it crashes in between, Will it commit an offset? For example if there are 500 documents in Kafka and after reading 250 documents Kafka crashes. Will it read from the 251st document when I run ...

abjoe by New Contributor II
  • 2593 Views
  • 2 replies
  • 0 kudos

Reusability Component in Snaplogic

Mapplet is a resusable component in IDQ in which we can pass generic fields to check the same condition for different fields. Suppose I want to make a generic mapping ( checking fields for Nullability and produce valid or invalid flag). Input fields ...