cancel
Showing results for 
Search instead for 
Did you mean: 

Parser issue with size

ryagnik
New Contributor

I am trying to parse 600MB files using json parser, file reader reads the file but json parser runs into following error -

Failure: Cannot parse JSON data, Reason: Exception while reading document from the stream, SLDB does not support data larger than 100 MB, Resolution: Please check for correct input JSON data.

What is the best practice here to parse large json file ? what is the role of SLDB here ? What is being stored in SLDB here ? even in the architecture document, there is no mention of SLDB here.

Can some one clarify the details here ?

8 REPLIES 8

psadasivam
New Contributor III

@ryagnik, From where you are reading the file? did you upload file to your SnapLogic project ?

I am reading the file from file server and use file reader snap to read the file.

aleung
Contributor III

can you share the “File name” value you have in your File Reader snap?

ryagnik
New Contributor

the name of the file is out.json.