I am reading SFTP directory through File Poller and File Reader using scheduled task running every 1 min.
I need to delete input files once processing is complete.
How do I achieve it?
One possible solution can be:
- Parent pipeline that will browse all the files from the SFTP location, and will pass the path of each file to child pipeline as pipeline parameter.
- Child pipeline that read/process all the files, perform all the logic on the files and then delete
processed files from the SFTP location using the File Delete Snap(using the path that you’ve sent as a pipeline parameter. Make sure the user/account that you are using have a delete permissions).
Any examples please.
In my pipeline,
I have a parent pipeline > child pipeline1 > sub-child pipeline 1.
And in parent I am using File Poller and File Reader.
How do I send file name in sub-child-pipeline 1 where there is file delete snap?