Problem Accessing file(SFTP) using File Reader Snap

[asepuri]

Hi All,

Am trying to create two pipelines with below information,

1. Loading a csv file from sftp onto sql server - Created a pipeline containing below objects and problem is validation takes forever. Is this the correct snap or should I use ‘CSV Read/Write’ snap for it or suspect something is wrong with account settings?

SFTP Account created as Basic Auth,

User Name: ftpuser@52.86.106.54:22

File location path(sftp) which I verified is working when trying to access from browser,

2. Loading a csv file from google drive onto sql server.

Tried using google spreadsheet reader snap and could only see excel files but not csv. Is this the correct snap or should I use REST snap pack for it.

Thanks in advance!

-Arun

[asepuri]

That worked but it takes me back to validation which runs forever,

Should I email customer support(support@snaplogic.com) to check for any performance issues.

[dmiller]

Yes, that would be the correct action to take.

[cj_ruggles]

Hi - you need to remove the “CSV Formatter” Snap - the “CSV Parser” Snap converts the document stream to JSON, and the “SQL Server - insert” Snap expects JSON as an input. You can see that the “CSV Parser” Snap’s output is a diamond (binary), which won’t connect up to the “SQL Server - insert”'s circle (JSON).

If the CSV is in the exact structure of the SQL Server table (same field names) then you might be able to connect the “CSV Parser” directly to the “SQL Server - insert”. Otherwise you can put a Mapper in between to map between the CSV structure and SQL Server table structure.

Good luck!