07-15-2024 07:57 PM
Hello,
I am using the Multi file Reader Snap to copy the files from a SFTP source location and write into a Storage blob container.
The process is to run every 30 mins to pick any file(s) that are available and write into a storage blob. There could be scenario where file may not be available in the source SFTP folder and in that case, the pipeline exits without any message.
What is the best way to capture if file is not available in the source SFTP folder.
In the below screenshot, the multifile reader snap is highlighted where the pipeline exits without any notification if there are no files in the source SFTP.
Thanks
Aravind N
Solved! Go to Solution.
07-22-2024 06:05 AM - edited 07-22-2024 06:21 AM
@arvindnsn, you can also try to use the below approach, where first you will use Directory browser snap (with selected option Ignore empty result), to check if there are source files created. After that you will use the Gate snap with unselected option "ignore empty string" and after the Gate snap you will have Router snap, that will orchestrate the flow, based on that is there any source file(s) present or not. If the files are there you will trigger MultiFile reader snap, otherwise, you will send email notification - no files.
07-22-2024 01:42 AM - edited 07-22-2024 01:50 AM
Hope this helps.
07-23-2024 07:26 PM
Thanks @hcherukuri for the solution. I was trying for an approach that would find if the file exists even before the process reaches the File Writer Snap. As mentioned in the other post, I was able to use the Gate Snap that basically would help attain that approach. Thanks again for your solution.
07-22-2024 06:05 AM - edited 07-22-2024 06:21 AM
@arvindnsn, you can also try to use the below approach, where first you will use Directory browser snap (with selected option Ignore empty result), to check if there are source files created. After that you will use the Gate snap with unselected option "ignore empty string" and after the Gate snap you will have Router snap, that will orchestrate the flow, based on that is there any source file(s) present or not. If the files are there you will trigger MultiFile reader snap, otherwise, you will send email notification - no files.
07-23-2024 07:20 PM
@ljupcho_machko1 Thanks for this solution. This seems to be a simple solution using the Gate Snap.