Hi,
We have implemented a pipeline using expression library file to do a lookup to get the transformed values. The expression library file is loaded from server. It is observed that after using expression library file it consumes more CPU than expected. Hence, please suggest is this the expected behavior of using expression libraries.
Thanks,
Abinaya
What makes you say that?
Did you try some other approach that behaved differently?
Hi @tstack
Yes. Previously we used In-Memory Lookup snap to do the lookup. To improve the performance we switched the design to use Expression libraries to achieve the same task. But after using expression library it is observed that it consumes more CPU comparatively though it helped in improving the performance.
How are you measuring CPU consumption?
I think what you might be seeing is that both approaches use about the same amount of CPU. But, since the library version finishes earlier, the CPU usage is bunched up in that shorter amount of time and there is less pausing. In other words, if one version took 2 minutes and consumed 50% of the CPU over that time, while the other took 1 minute and consumed 100% of the CPU, they used the same amount of CPU in the end.
