Forum Discussion

amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago

Best way to process millions of records in REST GET API call without Read time out error

Hi, I am trying to process millions of records by using REST GET snap API call. I am getting Read time out error. Is there a best way to bring in millions of records in REST call without facing Rea...
amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago

No. It failed after 6 hours of execution. I am wondering what could be the best solution to overcome this Read time out failure.

bojanvelevski's avatar
bojanvelevski
Valued Contributor
4 years ago

It’s highly likely that the API supports pagination, or some other way of chunking the requested data. That’s where I would go first. It will be helpful if you share the name of the API you are using, that’s it if you are able to.