Forum Discussion

pritam605's avatar
pritam605
New Contributor
2 years ago

Reading multiple files from ftp and loading it in snowflake table

I am trying to create and load a snowflake table based on multiple csv files that are stored in a ftp location. As of now, my approach looks like - Step 1: parent pipeline  File poller -》 Pipeline...
Ranjith's avatar
Ranjith
New Contributor II
11 months ago

Hi pritam605 ,

It appears that the _filepath, based on the provided context and the attached image, is not carrying the correct SFTP path for the CSV file. The Zip FileReader requires the SFTP path for each CSV file specified in the file settings at the snap level (e.g., sftp://sample.sftp.com/folder/filename). Currently, based on the snap configuration, it is looking for the file at the SLDB level instead of the correct SFTP path.