cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Parquet File Parse in Pipeline

alok_tiwari
New Contributor III

Hi,

I am working on an scenario where I am reading the File from SFTP location Which is in Parquet format and wanted to Parse the data in the file so that I can write to SLDB in CSV Format.

I need help with Parsing of the Parquet file in Pipelines.

 

2 REPLIES 2

bojanvelevski
Valued Contributor

Hi @alok_tiwari ,

There's a Parquet Reader snap that might help you in this case. Check this out:

https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438228/Parquet+Reader

Regards,

Bojan

Thank you @bojanvelevski 

I have already went through this The parquet Reader Snap but it only supports HDFS, ADL (Azure Data Lake), ABFS(Azure Data Lake Storage Gen 2 ), WASB(Azure storage), and S3 protocols. 

Let me know if I can use the SFTP here.

Regards,

Alok