Designing and Running Pipelines

Transform JSON to Ndjson

Hi, I am getting JSON from my SQL Server - Select snap I want to convert it into NDJSON to push the data into ElasticSearch example:- the data from SQL server: [ { “Id”: “1”, “Type”: “student”, “Name”: “s one”, “Age”: 27 }, { “Id”: “2”, “Type”: “teac...

Fixed Width Formatter Generate Blank file

Hi, I am using fixed width formatter in my pipeline and If I don’t have any data in the source and fixed formatter generates one output and create a blank file. Do we have any other functionality similar to ignore empty stream.

Resolved! RPE only returns small proportion of documents

I have a RPE running with the snaplogic recommended data science docker image. When i pass documents to the remote python script (hundreds, sometimes thousands) I only get around 1% of the documents back from the snap. Even when i literally pass the ...

Resolved! Convert data from SQL select to JSON

What is the best way to take data from a SQL Select statement and convert to JSON so that it can be used in a API put commend?

Passing a custom sql server data type into a stored procedure

Given the below sql server procedure definition excerpt. How would we pass in an array of data into this this datatype as the input parameter of the stored procedure. when passing in a straight array of values we get the following error. “reason”: “E...

Error message on snowflake bulkload

I am trying to migrate the data from MySQL to Snowflake DB. I am getting th following error message with snowflake bulk load snap. I have entered the data for all the columns but still getting the same error. “reason”: “The·input·to·the·SF·Bulk·Load...

How to load Today Date Files from s3 Bucket to SLDB

Hi, I am getting the files from amazon s3 bucket every day, I want to load today date files from s3 bucket to SLDB.Any one can help me on that. Thanking you in advance. Thanks M SATHISH

Routing files from S3

Continuing the discussion from How to load Today Date Files from s3 Bucket to SLDB:

SnapLogic - Integration Nation

Forum Posts

Transform JSON to Ndjson

Fixed Width Formatter Generate Blank file

Resolved! RPE only returns small proportion of documents

Resolved! Convert data from SQL select to JSON

Passing a custom sql server data type into a stored procedure

Error message on snowflake bulkload

How to load Today Date Files from s3 Bucket to SLDB

Routing files from S3

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings