06-03-2024 10:54 AM
I am trying to paginate using a POST HTTP CLIENT Snap. I don't know how to accomplish this with the information provided in the data returned. I am extracting data from HubSpot using the 'search' endpoint (https://api.hubapi.com/crm/v3/objects/contact/search). The data returned looks like this:
How do I use this information to configure the snap to paginate?
Please Help!
Solved! Go to Solution.
06-11-2024 08:38 AM - edited 06-11-2024 05:39 PM
@koryknick, Thank you for your help. I was provided a solution by a coworker.
It's essentially that pipeline solution you provided HTTP Client Pagination with a few tweaks. I modified the HTTP Client as follows: Removed pagination configurations and the parameters configurations for both http snaps and added to the body of the 2nd HTTP snap "after" : $splitValue, "limit" : 100 Then I was getting subsequent data. But the data was duplicating. So I modified the map for pagination as follows:
06-05-2024 02:40 AM
Hi,
I had the exactly same problem and could not find a way to do that. The documentation is poor. What I had to do was develop a python script to achive this to load lots of historical data with pagination because the api allowed me only to retrieve 1000 records at a time.
06-05-2024 07:04 AM - edited 06-05-2024 07:05 AM
Thank you for taking the time to reply @fabriciocarboni. Did you create the python script in snaplogic? If so did you have to install any python packages to get it to execute?
06-05-2024 07:15 AM
Hi @snapation6713,
No, our Snaplogic subscription does not have RPE. So I had to develop the script and run it from my local machine.
06-05-2024 07:57 AM
Ah! Ok thank you so much for your time!
Enjoy your day.