09-04-2020 09:00 AM
I have a pipeline which updates records between systems. The pipeline runs on a schedule and some records are not getting updated.
Hence I want to create a log file which is written to everytime the pipeline runs. The log file would hold the date/time of the run and details of the records that were dated and the status.
I can create a new log file every time the pipeline runs, but is there a way to have a log single file for all runs so that it is easier to review?
09-05-2020 08:13 PM
Only some file systems will allow “Append” actions.
In the file writer snap you will see you can select Append as the action, but in the Tooltip, you will see:
Append file action is supported for FILE, SFTP, FTP, FTPS and ADL protocols only
Choose one of those file protocols to achieve what you seek.
09-07-2020 08:41 AM
I wanted to store the file as a Snaplogic file for easy access, is that not possible?
The only other way that I can see to get it work, is read the file, add the values and write the file, but I also need logic to create when the pipeline is run fo the first time.
Peter
12-20-2022 12:34 AM
@peter , were you able to get solution to this? i have a similar requirement.