04-12-2024 11:30 AM
I'm working on a long pipeline that calls a number of child pipelines and passes a lot of data. Is there some way that I can design the pipeline, so that my original documents values don't get buried in many layers of $original.original.original... It's a constant battle to find the data I started with, and every time I need to add a step, I have to also fix all the steps after. I use jsonPath($,"$..columnName") sometimes, but I there are many columns of data. Is there a better way?
04-12-2024 05:47 PM
@wpenfold - a simple method to avoid this is to remap the $original object back to root after each snap that pushes the data down into $original. For example, you can push all fields in $original into the root object with the following:
Hope this helps!