Designing and Running Pipelines

Suppressing unwanted columns inside the Array

Hi, I have following json data. It has array of map with 3 different columns in it. Input: [{ “Phone”: [{ “Phone”: “3333333333”, “PhoneType”: “1”, “DonotCall”: “Y” }, { “Phone”: “1234567890”, “PhoneType”: “2”, “DonotCall”: “N” }] }] Expected Output: ...

Reading Custom Headers from a triggered Task

I have not been able to access any custom header parameter (not query or URI parameter) that I am posting to snaplogic after I setup a triggered task for a pipeline. I am able to get the JSON in the body successfully but havent been able to find a wa...

Batch Load Snap for calling RESTFUL API (HTTP GET)

Do we have Snap that can call RESTFUL API in batch of 50 or 100 @sinhavivek @kpatnala

Maximum Slots in a Plex and performance

The default Maximum slots of a snaplex is 4000. I have a pipeline that calls a large number of child pipelines (>1900) the total number of snaps combined across all the child pipelines is likely to be well over 15000. This pipeline is taking a very ...

Increase Groundplex max capacity for live ultra pipelines

Hi, From time to time, I run into the following error when attempting to execute ultra tasks on SnapLogic: {“query_string”: “”, “path”: “…”, “response_map”: {“error_id”: null, “error_list”: [{“query_string”: “”, “path”: “/api/1/rest/pipeline/prepare/...

BOX JWT Authentication

Hi All, I need to access box using API’s with service account. I am stucked at JWT Authentication in Snaplogic. Anyone have any idea how can I authenticate using JWT config file. Box Reference : https://developer.box.com/docs/construct-jwt-claim-manu...

How to implement jsonschema validation using Python script

Hi i’m trying to validate simple json data against particular json schema using python script. i’m trying to use ‘cerberus’ library of python but script snap is failing with error. How we can import external library and use it in script snap?any oth...

Parquet Reader & Writer through azure S3

For saving data in parquet format in s3 , below is the pipeline configuration. This pipeline creates meta data from the data itself , though it uses parquet data type ‘binary’ which is equivalent to string. the first mapper converts the doc into str...

SnapLogic - Integration Nation

Forum Posts

Suppressing unwanted columns inside the Array

Reading Custom Headers from a triggered Task

Batch Load Snap for calling RESTFUL API (HTTP GET)

Maximum Slots in a Plex and performance

Increase Groundplex max capacity for live ultra pipelines

BOX JWT Authentication

How to implement jsonschema validation using Python script

Parquet Reader & Writer through azure S3

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings