I have a requirement wherein I have to Pull all the files from a particular folder of SFTP and then Process them. I have a couple of questions on error handling part of it
- How should I check that there is no error while fetching the files?
- What if only a few files are pulled by snap and then the connection is lost? In this scenario, only some files will be processed and there would be data inconsistency
Any suggestions to handle this scenarios