Designing and Running Pipelines

DateTime Milliseconds issue with AZURE bulk load

Hi, When migrating data from DB2 to Azure using Azure bulk load snap, the milliseconds are not populating in Azure SQL tables ( data type used is datetime2(7) ). For milliseconds the data is coming as ‘0000000’. On DB2 side the, timestamp format is y...

JSON Formatting and Merging

Hello All, I have encountered a scenario where we need to map all the element with key, “tree”, to a single array of the same name. I have provided an example below Input: [{ “tree”: { “name”: “DB1” “type”: “database” “children”: [{ “name”: “SCHA” “t...

Detected a stalled snap thread: Pipeline Execute

Team, We are seeing this message in the Pipeline Execute Snap “Detected a stalled snap thread: Pipeline Execute”. And the child pipeline did not process any document but shows that the execution time as 14 hours and still executing. The first snap in...

Pipelines integration/linnking

Hi All , I have a requirement to link different pipelines under a project which appears like below. please let me know the possibilities. structure –>Projects ---->Shared ----->Folder1 ------>Folder2 ------>Folder3 I am trying to link the last pipeli...

Limit/Restrict the CSV parser output instead of scanning entire file

Is there is any possible ways to limit the CSV parsing output? Say for example, I have 30 + GB of CSV file, from this file I need to get only first two lines of data i.e. The first line is header and second line is data. I hope skip lines wont’t work...

How to change data size in mapper

Hello Community, I would like to change data size of below columns in mapper ,before loading data into SAP. How can I achieve it?

Read snowflake table and send email on failure

I am a Data Engineer and very new to SnapLogic. I want to create a pipeline which reads table from snowflake and on failure, send email. Please help me, Thanks in advance

Embedding SnapLogic in a SaaS product

We are a SaaS product company. We use SnapLogic as the iPaaS integration platform in our product. We have built pipelines to onboard data from our customer’s source systems (erp, google drive, sftp etc.) and bring it into products data lake. Currentl...

SnapLogic - Integration Nation

Forum Posts

DateTime Milliseconds issue with AZURE bulk load

JSON Formatting and Merging

Detected a stalled snap thread: Pipeline Execute

Pipelines integration/linnking

Limit/Restrict the CSV parser output instead of scanning entire file

How to change data size in mapper

Read snowflake table and send email on failure

Embedding SnapLogic in a SaaS product

optional field on mapper

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper