Forum Discussion

arunnp's avatar
arunnp
New Contributor II
5 years ago

Need to join the input array of objects to string

Hi The json input I get to the pipeline is array of objects. I need iterate each object data and join as a string. Also I need to append some html code in between. Ex: input json “chathist”: ...
SpiroTaleski's avatar
SpiroTaleski
Valued Contributor
4 years ago
Copy Link

@Wassim

Below are some points that you should take about In-Memory Lookup Snap:

  • The join operation within the snap will start, when the right input document stream ends. Meaning that, in your case the snap first will wait the aggregation of the data to be completed and then processed by In-Memory Lookup.
  • All the right input data is loaded in memory(of the JVM) as a lookup data. So, it is possible for the Snap to cause a poor performances.

Did you have another processes that are running in parallel with this process, that are also using similar snaps(join, snaps for aggregation, group snaps etc.) inside, which have an impact of the memory?

Did you tried the same scenario using JOIN Snap?

Regards,
Spiro Taleski