I have a pipeline which updates records between systems. The pipeline runs on a schedule and some records are not getting updated.
Hence I want to create a log file which is written to everytime the pipeline runs. The log file would hold the date/time of the run and details of the records that were dated and the status.
I can create a new log file every time the pipeline runs, but is there a way to have a log single file for all runs so that it is easier to review?