HTTP client
**Task :**We have n number of records in the below URL, we have to pull all the records. For each request there should be limit of 10 records for testing.
How to use Pagination for this Task,
Not...
Forum Discussion
Cursor pagination is actually typically much more straightforward, you should typically have a "next url" or "next page cursor" and if there's no next page, that should be null or empty, in that case your has next would be something like $.entity.paging.nextCursor != null and you would likely use an override query parameter with something like cursor being equal to $.entity.paging.nextCursor. Typically, cursor pagination uses the cursor as a query parameter after the initial page, you'd have to see how the documentation claims to pass in the cursor, though.
Thanks for the reply ddellsperger . Odd that I didn't get a email notification with your update. I checked the notification settings and they all look right. Odd.
Anyways...I tried the above and there is no paging "level" in my response...it just goes $entity.records....I've emailed the guys that built the API to ask them about a cursor parameter as their documentation doesn't mention one. I will circle back.
Do you know maybe where the cursor information is, as long as you can see the cursor somewhere in the response, you should be able to work through that (feel free to reach out via message if you want to take a look at it together)
ddellsperger was able to help me get this resolved. If you do not have an offset, limit, or start in the JSON response anywhere AND the pagination type is "cursor", you can do the following settings in your HTTP snap and this will get you all the records.
- Has next: $entity.records.length != 0 (your $entity.records might be different depending on how your JSON response looks. This is just the location where your data is located)
- check the check box for "Reuse request parameters."
- Override parameters: my API had a query parameter called objectsBefore that I could use. For the name I did objectsBefore, value was $entity.records[$entity.records.length - 1].id (basically what this is doing is getting the LAST record in the array and using that as the objectsBefore value then to page to the next set of records)
- Chris
