Designing and Running Pipelines

Challenges With Slow Match Snap Levenshtein Comparisons

We are using the Match Snap to do fuzzy-comparisons and match Customer records without a unique primary key. This particular Snap is in the ML Data Preparation Snap pack. We traced a bottleneck to uses of the Match Snap that are using the Levenshtei...

How to Unzip tar.gz file

How to unzip tar.gz file? Zip File Read snap is not working for tar.gz files. I am trying decompress snap but I am not sure how to get individual files from the output of Decompress.

Resolved! Reusable pipeline with Aggregate / Group by fields

Is it possible (and how) to build reusable pipelines with Aggregate / Group by fields, where the “group by” clauses are dynamic (and the number of clauses is provided as a list in the document). I’ve been trying this with something as follows, but it...

Getting error in csv parser when connected to Decompress snap

Hi, I am trying to read multiple zip files from S3 location using Directory browser-> S3 File reader → Decompress → csv Parser. Currently I have 2 zip files in the location which I could see till decompress preview. But csv parser is failing with bel...

Resolved! Expression for Router

I have a Router snap which evaluates whether an ID exists for records returned in a Salesforce Read Snap. Some of these have an ID, others do not. Right now in the Router snap I have an expression for those that does, '$Id != null, but I can’t work o...

Questions on using the SQL Server – Merge snap, where is WHEN MATCHED logic?

Hello, I’m a new user to Snaplogic, so go easy. My question is on using the “SQL Server – Merge” snap: I’ve created a pipeline to import from a sftp csv-formatted source to merge (update or insert) into a table on an SQL server database. It’s partia...

Decompressing and reading WINDOWS zip files

Here is a pipeline that reads a .zip file, decompresses (unzips) it and parses it contents. Please note that our current “Decompress” Snap only supports BZIP2, GZIP and DEFLATE. Binary to Document Snap Encode or Decode property is set to NONE Mappe...

How to achieve below one : merging documents

Hi All, How to achieve this in snaplogic . I tried using different snaps like joiner,union,group by , but none is giving desired output. Input: [ { “filename”: “a1.dat”, }, "filename": "a2.dat", }, { “count”: 2, “type”: “pdf” } ] expected output is:...

SnapLogic - Integration Nation

Forum Posts

Challenges With Slow Match Snap Levenshtein Comparisons

How to Unzip tar.gz file

Resolved! Reusable pipeline with Aggregate / Group by fields

Getting error in csv parser when connected to Decompress snap

Resolved! Expression for Router

Questions on using the SQL Server – Merge snap, where is WHEN MATCHED logic?

Decompressing and reading WINDOWS zip files

How to achieve below one : merging documents

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...