Designing and Running Pipelines

Resolved! Reusable pipeline with Aggregate / Group by fields

Is it possible (and how) to build reusable pipelines with Aggregate / Group by fields, where the “group by” clauses are dynamic (and the number of clauses is provided as a list in the document). I’ve been trying this with something as follows, but it...

Getting error in csv parser when connected to Decompress snap

Hi, I am trying to read multiple zip files from S3 location using Directory browser-> S3 File reader → Decompress → csv Parser. Currently I have 2 zip files in the location which I could see till decompress preview. But csv parser is failing with bel...

Resolved! Expression for Router

I have a Router snap which evaluates whether an ID exists for records returned in a Salesforce Read Snap. Some of these have an ID, others do not. Right now in the Router snap I have an expression for those that does, '$Id != null, but I can’t work o...

Questions on using the SQL Server – Merge snap, where is WHEN MATCHED logic?

Hello, I’m a new user to Snaplogic, so go easy. My question is on using the “SQL Server – Merge” snap: I’ve created a pipeline to import from a sftp csv-formatted source to merge (update or insert) into a table on an SQL server database. It’s partia...

Decompressing and reading WINDOWS zip files

Here is a pipeline that reads a .zip file, decompresses (unzips) it and parses it contents. Please note that our current “Decompress” Snap only supports BZIP2, GZIP and DEFLATE. Binary to Document Snap Encode or Decode property is set to NONE Mappe...

How to achieve below one : merging documents

Hi All, How to achieve this in snaplogic . I tried using different snaps like joiner,union,group by , but none is giving desired output. Input: [ { “filename”: “a1.dat”, }, "filename": "a2.dat", }, { “count”: 2, “type”: “pdf” } ] expected output is:...

Resolved! Downloading a base64 zip file using SOAP

Hi All, I am trying to use SOAP call to download a zip file. However, I cannot download and get the file I need correctly. Here is a screenshot of my pipeline. I took out the $content, which contains a string that is (at least looks like) base64 enc...

Resolved! Jsonpath - how to use parameters or variables inside a jsonpath

Using jsonpath as the expression in a mapper snap the following works: jsonPath($, “$entity.items[?(@.AssignmentNumber==‘E3163300-2’)].links[*]”).find(x=>x.name == ‘assignedPayrolls’).href I want to pass in the assignment number from a parameter but ...

SnapLogic - Integration Nation

Forum Posts

Resolved! Reusable pipeline with Aggregate / Group by fields

Getting error in csv parser when connected to Decompress snap

Resolved! Expression for Router

Questions on using the SQL Server – Merge snap, where is WHEN MATCHED logic?

Decompressing and reading WINDOWS zip files

How to achieve below one : merging documents

Resolved! Downloading a base64 zip file using SOAP

Resolved! Jsonpath - how to use parameters or variables inside a jsonpath

Best Approach for Handling CSV Import with Truncat...

Fetch dashboard/monitor details via a pipeline

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?