Read and Write to Azure DataLake Store (ADL)

A simple pipeline that reads and writes to Azure Data Lake Store using the HDFS reader/Writer snap. The HDFS snap is configured to use the Azure DataLake Store account.

The HDFS writer is configured as below to write to ADL

image

The ADL URI is of the format where “fielddatalakestore” is the name of the container

adl://fielddatalakestore/data/demo/refined/output_csv/

Attached is the sample pipeline

Read Write to Azure DataLake Store (ADL)_2018_06_25.slp (7.1 KB)