Is there any limitation of data size that “JSON Splitter” snap can handle? I get a 36mb json as input and output less than 1mb. I noticed “JSON Splitter” simply truncates the data!!! Ideally it should not but it is happening!!! Anyone find such odd behavior ? Unfortunately I have to split the JSON to process each sub-element. For smaller size of source file, it works fine though.
Thanks @cstewart
I don’t want the data to be repeated, i followed the steps you said and got the output as like the above screenshot.
Please suggest a way to get data like
{
“data”: [
{
“classification_code”: “ARGENTINA”,
“reporting_country”: “Argentina”,
“sub_region”: “Rest of Latin America”,
“territory”: “LA”,
“global_region”: “Americas”,
“worldwide”: “Worldwide”,
“pos_customer_id”: 8,
“pos_customer_site_id”: 13
},
{
“classification_code”: “ARGENTINA”,
“reporting_country”: “Argentina”,
“sub_region”: “Rest of Latin America”,
“territory”: “LA”,
“global_region”: “Americas”,
“worldwide”: “Worldwide”,
“pos_customer_id”: 9,
“pos_customer_site_id”: 15
},
{
“classification_code”: “ARGENTINA”,
“reporting_country”: “Argentina”,
“sub_region”: “Rest of Latin America”,
“territory”: “LA”,
“global_region”: “Americas”,
“worldwide”: “Worldwide”,
“pos_customer_id”: 10,
“pos_customer_site_id”: 15
}
]
}
This is what, I did in JSON generator, PFB screenshot
Below is my pipeline
