Salesforce - filtering by the last run time of a Pipeline

Hi,

I am trying to use the last run time of a pipeline to filter Salesforce records by comparing their last modified date with the pipelines last run and was wondering what the best course of action is. I’ve seen a couple of varying ideas on how to go about this. I tried storing the timestamp from the pipeline in a json file and then calling it later down the line but I’m having trouble getting it to work and it makes the pipeline big and bulky.

Thank you!

Hi,

I use the same method, storing last run timestamp in a JSON file within SLDB. It did add some complexity to the pipeline, but it worked well. Another option, which I’ve not tried, would be to use the Pipeline monitoring API (see https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438155/Pipeline+Monitoring+API) to determine the last run timestamp for the Pipeline.