Designing and Running Pipelines

Reading Custom Headers from a triggered Task

I have not been able to access any custom header parameter (not query or URI parameter) that I am posting to snaplogic after I setup a triggered task for a pipeline. I am able to get the JSON in the body successfully but havent been able to find a wa...

Batch Load Snap for calling RESTFUL API (HTTP GET)

Do we have Snap that can call RESTFUL API in batch of 50 or 100 @sinhavivek @kpatnala

Maximum Slots in a Plex and performance

The default Maximum slots of a snaplex is 4000. I have a pipeline that calls a large number of child pipelines (>1900) the total number of snaps combined across all the child pipelines is likely to be well over 15000. This pipeline is taking a very ...

Increase Groundplex max capacity for live ultra pipelines

Hi, From time to time, I run into the following error when attempting to execute ultra tasks on SnapLogic: {“query_string”: “”, “path”: “…”, “response_map”: {“error_id”: null, “error_list”: [{“query_string”: “”, “path”: “/api/1/rest/pipeline/prepare/...

BOX JWT Authentication

Hi All, I need to access box using API’s with service account. I am stucked at JWT Authentication in Snaplogic. Anyone have any idea how can I authenticate using JWT config file. Box Reference : https://developer.box.com/docs/construct-jwt-claim-manu...

How to implement jsonschema validation using Python script

Hi i’m trying to validate simple json data against particular json schema using python script. i’m trying to use ‘cerberus’ library of python but script snap is failing with error. How we can import external library and use it in script snap?any oth...

Parquet Reader & Writer through azure S3

For saving data in parquet format in s3 , below is the pipeline configuration. This pipeline creates meta data from the data itself , though it uses parquet data type ‘binary’ which is equivalent to string. the first mapper converts the doc into str...

How to access Hive on Private subnet AWS

Hi, I am trying to connect hive server hosted on AWS ec2 machine which is in private subnet. I am using bastion host and tunneling process to connect to hive in sql-workbench and tableau. when i am trying to do the same process in snaplogic its not w...

SnapLogic - Integration Nation

Forum Posts

Reading Custom Headers from a triggered Task

Batch Load Snap for calling RESTFUL API (HTTP GET)

Maximum Slots in a Plex and performance

Increase Groundplex max capacity for live ultra pipelines

BOX JWT Authentication

How to implement jsonschema validation using Python script

Parquet Reader & Writer through azure S3

How to access Hive on Private subnet AWS

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...