Options for priority / throttling on pipelines?

Trying to find out any available options for setting a priority or throttling for pipelines.

The goal is to ensure that real-time transactional data flows aren’t effected by scheduled pipelines with lower requirements around timeliness of delivery.

This has typically been solved with designating the real-time transactional flows to Snaplex A and the lower priority pipelines to Snaplex B. This has generally worked well enough so far to keep more batchy things from impacting business real-time executions.

1 Like