How to create new array if there are more than 100 elements in the array

[Igor_Bozhinovsk]

Hi , currently we have an array that contains more then 100 elements , approximately 168. Is it possible with some transformation in the mapper to create another array that will contain the rest 68 elements ?

We would have 1 array with 100 elements and the other should contain the rest of the elments.

Or we can split the array if there are more then 100 documents , that would work too.

[alchemiz]

Hi @Igor_Bozhinovski,

Good day, you can also use the slice() function of an array… see sample below where $object have 210 key-value pair and $array has a length of 210

For grouping key-value pair by the 100s

‘,’.repeat(Math.floor($object.keys().length / 100)).split(‘,’).map((x,i)=> $object.filter((v,k)=> $object.keys().slice((i * 100), (i + 1) * 100).indexOf(k) != -1))

For grouping array by 100s
‘,’.repeat(Math.floor($array.length / 100)).split(‘,’).map((x,i)=> $array.slice((i * 100), (i + 1) * 100))

~Alchemiz

[Igor_Bozhinovsk]

Thanks Alchemiz , the array is now spliited in two. One array with 100 elements and the other with the remaining elements.

This is the current output :

"ShipmentCreateDate": "01/01/2023",
"ShipmentID": "1",
"SerialNumbers": [
  [
    {
      "SerialNo": "123"
    },
	{ "SerialNo":"456"
    }
  ],
  [
	{
	  "SerialNo": "101"
	},
	{
	  "SerialNo": "102"
	}
  ]
 ]

I was wondering if something like this output is possible :

"ShipmentCreateDate": "01/01/2023",
"ShipmentID": "1",
"SerialNumbers": [
  [
    {
      "SerialNo": "123"
    },
	{ 
	  "SerialNo":"456"
    }
  ]
"ShipmentCreateDate": "01/01/2023",
"ShipmentID": "1",
"SerialNumbers": [
  [
	{
	  "SerialNo": "101"
	},
	{
	  "SerialNo": "102"
	}
  ]
 ]

Where the first output would be the array with the 100 elements and the remaining fields that are not part of the array and the second output would be the array with the remaining elements and the fields that are not part of the array.

Regards,
Igor

[alchemiz · Accepted solution]

Hi Sir,

See attached PoC pipeline. Hope this helps

canvas_2023_01_10.slp (11.7 KB)

Thanks,
EmEm

[Igor_Bozhinovsk]

Thanks this is what i was exactly looking for.