Hi team, I am facing issue while splitting file based on 100mb size. In my case, i have 10 million records of data. i am using sl.range() function along with map() function.For example, if a line consists of 3mb data and i want to split based on 6kb....
Hi team,I m new to snaplogic and I want to split large fil into smaller files and zip them together. Any suggestions and explanations would be helpful.
Hello, I am trying to call a rest get API with some pagination. The API returns the next page URL within the response, so i should be able to use this in the snap. I am getting the value using JSON Path seen here in a mapper as an example: I use th...
Hello,I am calling Trustpilot API using HTTP request snap.I have given below values in 'Next URL' and 'has next' values in HTTP request snap.It is only giving 20 records.can you please provide your inputs?jsonPath($, "$.[*].links[?(@.rel=='next-page'...
Hello, I have source data in XML format and all the column entities have "@" as a prefix. I am trying the following expression using "hasPath" function in a mapper to determine if the output of the file has data.$.hasPath('Extract.Locations.Location....
When designing pipelines we have environment specific parameters (Dev, Test, Prod) in expression libraries. This renders our pipeline development independent of having to alter pipeline parameters or tasks between environments and deploys. However, t...
Hi, I am building error handler (with functionality to log error details in snowflake) for a nest pipeline (3 layers), and have a few questions 1. I want have captured pipeline parameters such as ruuid, startTime, but when I execute the functionality...
I use a diff snap to process records coming from a REST API call with records stored in a database. Records from the REST call are "New"; records from the database are "Original". When the diff is in the parent pipeline everything works as expect...
