Slow PostgreSQL Update Snap
I have a PostgreSQL Update snap at the end of a pipeline. It’s job is to update a column in a row if nothing in an inbound row (matching that data) has been modified. This means that most of the time...
Forum Discussion
What are reasonable numbers to bump those up to without bogging the whole system down?
Try a batch size of 500 and fetch size of 1000 first then observe performance of the pipeline, resource usage on the Snaplex, and if it is an on-premise database, keep an eye on that as well. If that jump doesn’t add impact to either size then you can try to increase it again. Depending on the size of your individual records you might want to only increase in increments of 500 or 1000 to start.
