Can't paginate using Post HTTP CLIENT Snap

[snapation6713]

I am trying to paginate using a POST HTTP CLIENT Snap.  I don't know how to accomplish this with the information provided in the data returned.  I am extracting data from HubSpot using the 'search' endpoint (https://api.hubapi.com/crm/v3/objects/contact/search).  The data returned looks like this:

"entity":{

"total":

479322

"results":[

{

"id":"123","properties":{...},"createdAt":"2022-06-10T05:49:44.061Z","updatedAt":"2024-05-23T11:58:59.795Z","archived":false

}.....

}

]

"paging":{

"next":{

"after":

"10"

}

How do I use this information to configure the snap to paginate? 

Please Help!

[snapation6713 · Accepted solution]

@koryknick,   Thank you for your help.  I was provided a solution by a coworker.

It's essentially that pipeline solution you provided HTTP Client Pagination  with a few tweaks.  I modified the HTTP Client as follows: Removed pagination configurations and the parameters configurations for both http snaps and added to the body of the 2nd HTTP snap   "after" : $splitValue, "limit" : 100    Then I was getting subsequent data.   But the data was duplicating.  So I modified the map for pagination as follows:  

sl.range(1, parseInt($entity.total), 100)  -I also changed the 1st http snap to just give me 1 record just so that I get the total  and I process from page 1 to the end in the rest of the pipeline so I don't do a union.  

And it worked!   I am now getting subsequent data and it the records are not duplicating.  

[koryknick]

@snapation6713 - very glad you worked out the solution!  And happy I was able to point you in the right direction.

[snapation6713]

Solution worked.