Get latest file from sftp and process one at a time
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-13-2020 12:08 PM
I want to get all files from yesterday’s date from ftp and process them one by one. There can be only one file and can be multiple files but they need to be processed one at a time. I tried using mapper , to get yesterday value “Date.now().toLocaleDateString(‘{“format”:“yyyyMMdd”}’)”
and then use file poller, and write in file filter Labor_FDC_${ye}*.dat,
but it doesn’t work. Also at the end after load, i want to update file name in target table that it is processed ,so that it is not processed again.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2020 08:47 AM
Thanks Ajay, but still the Path variable is not getting passed in child pipeline.I have trie dusing both _Path and Path varaible in child pipeline
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2020 08:54 AM
This seems to indicate that Path is not listed as a parameter in the Pipeline Properties dialog.
Can you verify that it exists?
Diane Miller
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2020 11:57 AM
Hello,
I have added now pipeline parameter in child pipeline as follows but still getting error. Below screenshot attached-
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2020 12:04 PM
OK, in that URL, is Path a file name or a project name?
Diane Miller
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2020 12:33 PM
Path is supposed to be file name
eg-
sftp://xxx.xx.x.xx/abc.dat
