This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Using Expression library in pipeline consumes more CPU than expected

abinayad
New Contributor

โ€Ž08-06-2019 04:19 AM

Hi,

We have implemented a pipeline using expression library file to do a lookup to get the transformed values. The expression library file is loaded from server. It is observed that after using expression library file it consumes more CPU than expected. Hence, please suggest is this the expected behavior of using expression libraries.

Thanks,
Abinaya

0 Kudos
4 REPLIES 4

tstack
Former Employee

โ€Ž08-06-2019 07:10 AM

What makes you say that?

Did you try some other approach that behaved differently?

0 Kudos

abinayad
New Contributor
In response to tstack

โ€Ž08-07-2019 05:53 AM

Hi @tstack

Yes. Previously we used In-Memory Lookup snap to do the lookup. To improve the performance we switched the design to use Expression libraries to achieve the same task. But after using expression library it is observed that it consumes more CPU comparatively though it helped in improving the performance.

0 Kudos

tstack
Former Employee
In response to abinayad

โ€Ž08-07-2019 07:15 AM

How are you measuring CPU consumption?

I think what you might be seeing is that both approaches use about the same amount of CPU. But, since the library version finishes earlier, the CPU usage is bunched up in that shorter amount of time and there is less pausing. In other words, if one version took 2 minutes and consumed 50% of the CPU over that time, while the other took 1 minute and consumed 100% of the CPU, they used the same amount of CPU in the end.

0 Kudos

SriVinayaga
New Contributor II
In response to tstack

โ€Ž08-07-2019 11:38 PM

Thanks @tstack,

I can see this is common problem not only for Expr library, we have XSD validation for which, initially we were loading the complex schema from sldb which was making a pipeline to run over 40 to 50 secs, and that wasnt consuming server resources much. But when we changed that to load the schema from the server using file protocol, The performance was improvised drastically where time taken came down to 6 to 8 secs, but the CPU utilization bumped up from 6 to 7 % to 50 to 60%.

Is this the expected behavior of SL nodes?

Thanks and regards,
Sri

0 Kudos