If I understand you correctly, you’re trying to fetch data from an API that has implemented pagination. The API will return a field called hasNext
that is either true or false depending on if there is more data. However, you want more control over the pagination as you don’t want to fetch all the data at one time. For example, you may only want to fetch the first 10 pages, instead of the full 1000.
One way to accomplish this is with a Sequence snap, where you can specify you want it to output 10 values, or however many pages you want to fetch. Then downstream use the Rest Get snap.
![]()
Here is an example pipeline to try out.
rest-pagination-example_2022_01_04.slp (3.8 KB)