Hello everyone.
How can we configure a pipeline which is called using a triggered task and returns and json payload to have paginated results?
The API call to the pipeline currently passes in parameters of which some are used in the call to a database stored procedure. Others determine how the returned dataset from the procedure is presented either via a file, an email or json payload.
If we don't account for large datasets, then records could be missed due to the 'Account - Fetch Size' setting, which we don't wan to set excessively high. Since the datasets being returned can have many thousands of records, perhaps we should paginate the results. How is this accomplished OR is there a better method?
Thank you.
