cancel
Showing results for 
Search instead for 
Did you mean: 

Problem Accessing file(SFTP) using File Reader Snap

asepuri
New Contributor II

Hi All,

Am trying to create two pipelines with below information,

  1. Loading a csv file from sftp onto sql server - Created a pipeline containing below objects and problem is validation takes forever. Is this the correct snap or should I use ‘CSV Read/Write’ snap for it or suspect something is wrong with account settings?

SFTP Account created as Basic Auth,

User Name: ftpuser@52.86.106.54:22

File location path(sftp) which I verified is working when trying to access from browser,
d0500ae6268156bf6b20c608d79527d5e52b5c11.png

  1. Loading a csv file from google drive onto sql server.

Tried using google spreadsheet reader snap and could only see excel files but not csv. Is this the correct snap or should I use REST snap pack for it.

Thanks in advance!

-Arun

7 REPLIES 7

dmiller
Admin Admin
Admin

In the 4.x code line, there isn’t a ‘CSV Read/Write’ Snap. File Read to CSV Parser is the correct configuration. Performance issues may require Support to investigate.

I don’t believe the Google Spreadsheet Reader reads CSV files, but I will double check with Development.


Diane Miller
Community Manager

asepuri
New Contributor II

Thanks!!

Even I tried below as per the file reader snap documentation,

f1bf2a0c38c2fddadb61ccca1c63add0110fd1c6.png

For google drive access,
Can we use REST snap pack for accessing csv files on google drive. Is this the right approach now??

asepuri
New Contributor II

Mapper Snap properties for above reply on the pipeline
e534aa0635ca6e7d516a9c433de5fe776d35348b.png

dmiller
Admin Admin
Admin

To use $filename in the File field, you need to toggle on the expression button (=). Without it, it is treated as a string.


Diane Miller
Community Manager