Designing and Running Pipelines

Resolved! How to generate a HTML file with Snaplogic

Hi, I want to dynamically generate a html file with Snaplogic. What are the best snaps to do this? Its best to have the ability to dynamically change the content of the html when pipeline is running. Thanks

Parquet without Hadooplex

Has anyone come up with a “simple” process to convert files to Parquet format without the need to use a Hadooplex and without going through HDFS. I would like to read a text file from S3 and convert it to Parquet back onto S3.

How to convert comma separated values to rows in SnapLogic?

I have a requirement, based on the column values I need to split the records ID NAME 1 abc,def,ghi 2 jkl,mno,pqr ID NAME 1 abc 1 def 1 ghi 2 jkl 2 mno 2 pqr Need to convert columns to rows in Snaplo...

hasOwnProperty will be deprecated?

I am getting the following warning during pipeline execution, where can I find more details? What is the suggested actions? WarningPassing: a JSON-Path to hasOwnProperty() is not supported and will fail in the future ResolutionUse: hasOwnProperty(...

Pipeline Execute parallel + sequential execution

The documentation mentions below, Execute a pipeline for every input document. If the target pipeline has an unlinked input view, the input document to this Snap will be passed into the unlinked input of the child execution. Similarly, if the target ...

Snaplogic as Apache Airflow alternative, maybe?

Anyone successfully use Snaplogic to manage their ETL hive queries? One of the main capabilities I need is the ability to dynamically initiate pipelines / hive queries based on table references. e.g. query 1: reference table 1, 2, 3 : write a query 2...

Ultra pipeline guaranteed delivery

I am evaluating ultra pipelines for converting existing pipelines to ultra (with the architecture one unconnected input view AND one or more unconnected output views). According to the press release: “Ultra Pipelines also bring guaranteed delivery of...

'Union' snap support in 'Ultra' pipelines

Are ‘Union’ snaps supported in ‘Ultra’ pipelines? As per the documentation for Union snaps, they are not. However in the blog post Pipeline Tools, Data Pipeline Design - SnapLogic they are part of the pipeline.

SnapLogic - Integration Nation

Forum Posts

Resolved! How to generate a HTML file with Snaplogic

Parquet without Hadooplex

How to convert comma separated values to rows in SnapLogic?

hasOwnProperty will be deprecated?

Pipeline Execute parallel + sequential execution

Snaplogic as Apache Airflow alternative, maybe?

Ultra pipeline guaranteed delivery

'Union' snap support in 'Ultra' pipelines

mapValues returns null when adding certain conditi...

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...