Forum Discussion

Sahil's avatar
Sahil
Contributor
4 years ago

Delete input file in pipeline

Hi,
I am reading SFTP directory through File Poller and File Reader using scheduled task running every 1 min.
I need to delete input files once processing is complete.
How do I achieve it?

4 Replies

  • SpiroTaleski's avatar
    SpiroTaleski
    Valued Contributor

    @Sahil

    One possible solution can be:

    1. Parent pipeline that will browse all the files from the SFTP location, and will pass the path of each file to child pipeline as pipeline parameter.
    2. Child pipeline that read/process all the files, perform all the logic on the files and then delete
      processed files from the SFTP location using the File Delete Snap(using the path that you’ve sent as a pipeline parameter. Make sure the user/account that you are using have a delete permissions).

    Regards,
    Spiro Taleski