01-08-2023 10:45 PM
Hi,
Why File Reader and File Writer size variation in the Pipeline?
I have make a simple pipeline to check my reader output file size and writer output file size and I have observed that reader and writer output size us not matching.
Could anyone please explain to me that.
01-09-2023 04:21 AM
@sshaikh: Is it a huge difference? Are you putting any transformations in your mapper snap?
01-09-2023 09:19 AM
Size of input file is 945 bytes in file reader and output in writer is 574 bytes. Yes did transformation in mapper snap but connected all input schema to output in transformation without any changes in the files.
01-09-2023 09:56 AM
That is expected right? as XML format uses nodes e.g.
<root><val>
the quick brown fox jumps over the lazy dog</val></root>
while JSON format uses key/value pair e.g {“root”: {“val”: “the quick brown fox jumps over the lazy dog”} }
Or am I missing something?
Thanks,
EmEm
01-09-2023 10:08 PM
@alchemiz can you please tell me why there is difference in file size by using below pipeline where I am reading and writing Json File.
File Reader(Json File)>>Json Parser>>Json Formatter>>File Writter