This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Error Handling while Connecting SFTP

shreegeet
New Contributor II

โ€Ž06-01-2020 02:40 AM

Hi,

I have a requirement wherein I have to Pull all the files from a particular folder of SFTP and then Process them. I have a couple of questions on error handling part of it

  1. How should I check that there is no error while fetching the files?
  2. What if only a few files are pulled by snap and then the connection is lost? In this scenario, only some files will be processed and there would be data inconsistency

Any suggestions to handle this scenarios

Regards,
Shreegeet

0 Kudos
1 REPLY 1

alchemiz
Contributor III

โ€Ž06-01-2020 06:55 PM

So, when you said โ€œPullโ€ will you be reading then processing or would you download the SFTP files into a temp folder (pipe.tmpDir) then read from that temp folder then process the file/s?

For a successful/complete downloading of files, I would suggest to enable the โ€œValidate after writeโ€ in the File writer snap
image

0 Kudos