Ish
New Contributor III
Joined 9 years ago
User Profile
User Widgets
Contributions
Re: REST Get delay between making calls as documents come in (not pagination or retry)
Another thing to mention – sometimes REST APIs tell you how long you have to wait until you can make the next call. It would be great if the REST Get could be enhanced to not only allow setting a delay, but also the ability to use the results from the previous call to set how long the delay will be before the next one.3.4KViews1like0CommentsREST Get delay between making calls as documents come in (not pagination or retry)
Hello, For the REST Get snap, there’s a feature to set a delay interval between Pagination and Retry calls, but what about just between regular calls as documents come in? All calls to REST can be rate limited, not just pagination calls. Do I have to create a sub-pipeline with a script delay to achieve this? Thanks!Solved4.6KViews1like5CommentsWhat is the maximum allowed length of Triggered URL?
Hello, If I have a triggered task that I’m passing parameters to as key=value pairs in the query string, for example: https://elastic.snaplogic.com:443/api/1/rest/slsched/feed/.../task/?param1=123¶m2=456 What is the maximum allowed length of that URL? Thank you!2.5KViews0likes1CommentRe: Conditionally Remove or Add a Field
Thanks @Supratim! I really appreciate you taking the time to put that together for me. I’m hoping this is possible to do in a way that is more akin to what I believe is the UX philosophy of SnapLogic though. If constructing an array/object on the fly and applying a filter on a single line is currently the way to achieve this, I’ll put this in as a feature request.3KViews1like3CommentsConditionally Remove or Add a Field
Hello, How do you conditionally remove (or add) a field to a document? E.g., I have a mapper: Expression → Target Path 20 → $field1 10 → $field2 ‘’ → $field3 null → $field4 So I now have: [ { ‘field1’:20 ,‘field2’:10 ,‘field3’:‘’ ,‘field4’:null } ] Now for example in pseudo code: if ( $field2 > 5 ) { delete($.field2) } if ( $field3 == ‘’) {delete($.field3) } if ( $field4 == null ) { delete($.field4) } So now it looks like: [ { ‘field1’:20 } ] How can I do that? Note: I can achieve this with a JSON Generator using Apache Velocity, but I’m hoping there is a way to do this using something like a Mapper. It would also be OK to do this in the opposite direction, e.g., if ( $input <= 4 ) { create($.field2, $input) } Let me know if you have any questions, Thanks! Ish4.6KViews0likes5CommentsRest GET - Next URL with page=# syntax with no metadata
Hello, I’m calling a REST API which requires me to increment a ‘page’ value in order to get all the results. The issue is the API doesn’t return any metadata. For example: 1st call is: https:domain.com/object/page/1 Results: { entity:[ {…},{…},… ] } Has next: typeof $entity == ‘array’ && $entity.length > 0 Next URL: https:domain.com/object/page/2 The problem is how to I compute the 2 (then 3,4,5… etc) Is it possible to increment a value by 1 on every subsequent call? Or is it possible to access a variable that counts how many times the call has been made? Thanks!4.2KViews0likes4Comments