Forum Discussion

LordNeilLord's avatar
LordNeilLord
New Contributor II
3 years ago

REST Get Slow

Hey guys,

I have built a simple REST Get process to grab some data from an API. There are about 100 URLs to call but it is taking ages. 100 URLs takes about 7 mins whereas in another software application the 100 calls takes about 25s!

I have tried using the REST Get snap in a child pipeline and increasing the pool size but I’m still not getting anywhere the speed I would expect.

Any suggestions?

  • del's avatar
    del
    Contributor III
    5 years ago
    Copy Link

    This is not a challenge… just sharing an example 🙂
    Community.9634.slp (3.6 KB)

    I believe an expression file arrow function is the right way to go

    I agree completely.

    • koryknick's avatar
      koryknick
      Employee
      5 years ago
      Copy Link

      Thanks for the example Del - I was thinking of this differently. Agree that eval would work - but performance would be seriously impacted.