Subpipeline - Lookup
We have a requirement to do a lookup on a db table and get additional attributes. This lookup is being done in a sub-pipeline. We would ideally like to load the lookup data into memory and do an in-m...
Forum Discussion
Yes, we tried the in-memory lookup, but it looks like every time the sub-pipeline is executed the data in memory is being refreshed. Since the sub-pipeline is being called from the parent for each record, this is taking a long time.
instead of sub-pipeline do a lookup in main pipeline and re-use the values e.g.
Here you can see I am doing lookup once (My SQl- Select). I am using this lookup for all records via In-Memory lookup snap
