@winosky I am not 100% sure about your data set , but is somehow any of the element you copied is an array and you using json split of that array in any of the output of copy snap?
You can try that option - use group by N snap and make size as 0 for both the output view of copy, then use json splitter (data_set array) to get all required data you want after copy snap.
Hi @Supratim, it’s a copy of json from a execute snap into a aggregate. I believe the aggregate may be the problem, I’ve read it was resource intensive so I need to find an alternate solution.
If you can post a pipeline and small data set that reproduces the issue, I can take a look at it. Otherwise, you could reach out to support for additional help.
Thanks @tlikarish, I’ve already altered the pipeline and things are looking better. I had to avoid using the copy snap and aggregate or at least minimize the data set before it got to the aggregate.
