Forum Discussion

New Contributor

3 years ago

File Size Differences

Hi, Why File Reader and File Writer size variation in the Pipeline? I have make a simple pipeline to check my reader output file size and writer output file size and I have observed that rea...

Valued Contributor

3 years ago

@sshaikh: Is it a huge difference? Are you putting any transformations in your mapper snap?

sshaikh
New Contributor
3 years ago
Size of input file is 945 bytes in file reader and output in writer is 574 bytes. Yes did transformation in mapper snap but connected all input schema to output in transformation without any changes in the files.
- ptaylor
  Employee
  3 years ago
  Why do you expect the size to be the same? You’re changing the format from XML to JSON. JSON is less verbose than XML, so if it contains the same data, I would expect it to be smaller.
  - sshaikh
    New Contributor
    3 years ago
    @ptaylor
    File Reader(Json File)>>Json Parser>>Json Formatter>>File Writter
    If I read and write the file using above pipeline I am getting the reduced File Size at end.
    Why there is Difference in file Size ?
    Is there difference due to conversion from DOC to Binary and vice versa ?
- alchemiz
  Contributor III
  3 years ago
  That is expected right? as XML format uses nodes e.g.
  
  <root><val>the quick brown fox jumps over the lazy dog</val></root>
  
  while JSON format uses key/value pair e.g {“root”: {“val”: “the quick brown fox jumps over the lazy dog”} }
  
  Or am I missing something?
  
  Thanks,
  EmEm
  - sshaikh
    New Contributor
    3 years ago
    @alchemiz can you please tell me why there is difference in file size by using below pipeline where I am reading and writing Json File.
    File Reader(Json File)>>Json Parser>>Json Formatter>>File Writter