How to Filter in a Non-Ultra Pipeline?

I am new to SnapLogic. I have a requirement to execute a REST snap that will return tens of thousands of nested JSON records and only flatten and export records that were modified yesterday.

The Filter snap documentation says it only works in Ultra Pipelines, and the Ultra Pipeline documentation says “Ultra Pipeline tasks are used to implement real-time web service integrations which require expected response times to be close to a few sub seconds.” The REST snap execution will take substantially more than a few sub seconds given the number of records expected.

Given that, what do I have to do to meet the requirement to only export flatted JSON records that were updated yesterday?

I think there’s a misunderstanding about the documentation. “Works in Ultra Task Pipelines” doesn’t mean a snap only works in Ultra pipelines. All snaps work in non-Ultra pipelines, but only some work in Ultra pipelines.

1 Like