cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Parser issue with size

ryagnik
New Contributor

I am trying to parse 600MB files using json parser, file reader reads the file but json parser runs into following error -

Failure: Cannot parse JSON data, Reason: Exception while reading document from the stream, SLDB does not support data larger than 100 MB, Resolution: Please check for correct input JSON data.

What is the best practice here to parse large json file ? what is the role of SLDB here ? What is being stored in SLDB here ? even in the architecture document, there is no mention of SLDB here.

Can some one clarify the details here ?

8 REPLIES 8

psadasivam
New Contributor III

@ryagnik, From where you are reading the file? did you upload file to your SnapLogic project ?

I am reading the file from file server and use file reader snap to read the file.

aleung
Contributor III

can you share the โ€œFile nameโ€ value you have in your File Reader snap?

ryagnik
New Contributor

the name of the file is out.json.