Writing a forEach

[krupalibshah]

Hello,

I have a use case where I am getting my input in tab delimited form, which after doing a groupBy N I am converting to an array so that I can make some comparison operation.

I need to extract the records from this array group for below mentioned conditions,

1. All records between a line starting with ‘8’ and value of 5th column as 3 till line starting with ‘9’.
2. All records between a line starting with ‘8’ and value of 5th column as 4 till line starting with ‘9’.
3. All records between a line starting with ‘8’ and value of 5th column as 5 till line starting with ‘9’.

Wanted to write a forEach to achieve 3 arrays as mentioned above. After getting the 3 arrays I need to check if all value of 3rd col of array1 are present in value of 4th col of array2 and pic only the ones that are present.

For doing all these I wanted to get some help to be able to get the desired output in optimum way.

[Suvigya]

Hi Aditya,

Can you please let us know what is approx size limit permissible? Currently we have less clarity on the same.

Thanks
Suvigya.

[aditya_sharma]

Hi Suvigya,

As I mentioned in my previous post, I am not sure how we can do this easily in Snaplogic, may be someone more expert in it will give you some good idea. I asked you about size because if it is not that big like few MB(s) or depending on the machine on which you are processing this file, you can write a simple program in any programming language, I would prefer Python because you can do complex things with few lines of code in it, you can achieve desired output very easily. Implementing your requirement is pretty easy in Python.

Thanks
Aditya

[aditya_sharma]

krupalibshah:

9 1151 10 04222016 16 2380 0 4.4 10000978 6

Hi Suvigya,

I just read your another post regarding making multiple documents as one, though you have mentioned in this post too that you are using GroupByN but I didn’t know that with the help of GroupByN you can combine all the documents as one. So if you use a script snap after the group by N snap you can implement your logic either in Java/Python/JavaScript.

Thanks
Aditya