Pagination in REST API

[Siva_Venna]

A very good explanation of how to implement pagination in REST API in this below blog post:

SnapLogic – 4 Feb 16

REST GET and the SnapLogic Public APIs for Pipeline Executions

As a part of a wider analytics project I’m working on, analyzing runtime information from the SnapLogic platform, I chose ...

When I try to implement the same(I am extracting data from survey monkey api), I have noticed that when the “Next URL” is executing it is ignoring the query parameters provided.As shown in below image, when service URL is executing it’s getting right records considering all input query parameters i.e total:3043 but when “Next URL” is hitting it is extracting all records i.e. total : 61896

How to include query parameters in “Next URL” to get required data?

[ptaylor]

Please share your configuration of the Snap’s settings.

[Siva_Venna]

below is configuration of Snap’s settings.
service URL: https://api.surveymonkey.net/v3/collectors/xxxxx/responses/bulk

In the “Next URL” i have replaced “offset” with “page” api is throwing error as bad request, may be api don’t accept parameter as offset.error below

[ptaylor]

I can’t see the entire expression for Next URL in your screen capture, but it seems more complicated than it needs to be. Try this: “https://api.surveymonkey.net/v3/collectors/xxxxx/responses/bulk?per_page=” + ($entity.per_page) + “&page=” + ($entity.page + 1)

[ptaylor]

Actually, after looking at the Survey Monkey API docs, I think it’s even easier. Try this:

Has next: ‘next’ in $entity.links
Next URL: $entity.links.next