Designing and Running Pipelines

Maximum Slots in a Plex and performance

The default Maximum slots of a snaplex is 4000. I have a pipeline that calls a large number of child pipelines (>1900) the total number of snaps combined across all the child pipelines is likely to be well over 15000. This pipeline is taking a very ...

Increase Groundplex max capacity for live ultra pipelines

Hi, From time to time, I run into the following error when attempting to execute ultra tasks on SnapLogic: {“query_string”: “”, “path”: “…”, “response_map”: {“error_id”: null, “error_list”: [{“query_string”: “”, “path”: “/api/1/rest/pipeline/prepare/...

BOX JWT Authentication

Hi All, I need to access box using API’s with service account. I am stucked at JWT Authentication in Snaplogic. Anyone have any idea how can I authenticate using JWT config file. Box Reference : https://developer.box.com/docs/construct-jwt-claim-manu...

How to implement jsonschema validation using Python script

Hi i’m trying to validate simple json data against particular json schema using python script. i’m trying to use ‘cerberus’ library of python but script snap is failing with error. How we can import external library and use it in script snap?any oth...

Parquet Reader & Writer through azure S3

For saving data in parquet format in s3 , below is the pipeline configuration. This pipeline creates meta data from the data itself , though it uses parquet data type ‘binary’ which is equivalent to string. the first mapper converts the doc into str...

How to access Hive on Private subnet AWS

Hi, I am trying to connect hive server hosted on AWS ec2 machine which is in private subnet. I am using bastion host and tunneling process to connect to hive in sql-workbench and tableau. when i am trying to do the same process in snaplogic its not w...

Error message in SMB write: 'can't encode character u'\\u2018' in position 23: ordinal not in range'

I have a File Writer Snap that needs to be able to write to a network smb drive. Since the network drive’s operating system software is a bit out of date, I’ve also been told to try the ‘cifs’ command. This is what I have in the File Write: ‘smb:\sha...

Reading compressed file and writing compressed files

Can we read a compressed password protected file and extract ? Vice versa can we read a file compress it and make it password protected?

SnapLogic - Integration Nation

Forum Posts

Maximum Slots in a Plex and performance

Increase Groundplex max capacity for live ultra pipelines

BOX JWT Authentication

How to implement jsonschema validation using Python script

Parquet Reader & Writer through azure S3

How to access Hive on Private subnet AWS

Error message in SMB write: 'can't encode character u'\\u2018' in position 23: ordinal not in range'

Reading compressed file and writing compressed files

Best Approach for Handling CSV Import with Truncat...

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?