feenst
8 years agoNew Contributor III
Options for priority / throttling on pipelines?
Trying to find out any available options for setting a priority or throttling for pipelines.
The goal is to ensure that real-time transactional data flows aren’t effected by scheduled pipelines with lower requirements around timeliness of delivery.
This has typically been solved with designating the real-time transactional flows to Snaplex A and the lower priority pipelines to Snaplex B. This has generally worked well enough so far to keep more batchy things from impacting business real-time executions.