This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

REST GET Snap error (SLDB does not support data larger than 100 MB)

bharath
New Contributor

โ€Ž09-14-2017 06:03 AM

Hi All,

Trying to get fileโ€™s from Rest API using Rest get snap ,while getting a large file from API more than 1 GB ,Snap throws below error.

Failure: Failed to process HTTP response, Reason: SLDB does not support data larger than 100 MB, Resolution: Please check the values of Snap properties

0 Kudos
2 REPLIES 2

CMeyers
New Contributor II

โ€Ž10-18-2017 12:02 PM

We had the same issue. This occurs because the preview data is written to SLDB and has a 100mb limit, which is usually fine for the 50 rows of data, but for large REST responses that contain an internal array of items within a single document that limit is easily reached. This is however only a preview time error, as a full run does not create previews, so actually running the pipeline worked fine and did not cause the error.

jaybodra
New Contributor III

โ€Ž10-19-2017 06:05 PM

I have encountered this issue and my workaround was save it to s3 using file writer and then read it as a normal file.

0 Kudos