8 hours ago
Hi,
I have certain observations while running a pipeline with SQS snap as trigger.
1. On startup, pipeline reads all available messages from sqs and hold them in buffer and process them as per concurrency
2. There is no mechanism to control the speed at which we poll messages from queue.
If you have used sqs consumer snap in your pipelines, how did you tackle above issues.
Any throttling mechanism did you implement to control this.
Thanks,
Vishal.