Forum Discussion

ryagnik's avatar
ryagnik
New Contributor
8 years ago

Parser issue with size

I am trying to parse 600MB files using json parser, file reader reads the file but json parser runs into following error - Failure: Cannot parse JSON data, Reason: Exception while reading document ...
transform
ryagnik's avatar
ryagnik
New Contributor
8 years ago

I am reading the file from file server and use file reader snap to read the file.

aleung's avatar
aleung
Contributor III
8 years ago

can you share the “File name” value you have in your File Reader snap?

  • ryagnik's avatar
    ryagnik
    New Contributor
    8 years ago

    the name of the file is out.json.

    • ryagnik's avatar
      ryagnik
      New Contributor
      8 years ago

      please note that this only happens in preview mode, I was able to execute the pipeline with large file.

      • ryagnik's avatar
        ryagnik
        New Contributor
        8 years ago

        Please note that with large files, I can’t validate the pipeline but I can execute it.

        So I think it is a defect which does not allow us to validate the pipeline with large file.