Hello, I am using the Multi file Reader Snap to copy the files from a SFTP source location and write into a Storage blob container.The process is to run every 30 mins to pick any file(s) that are available and write into a storage blob. There could ...
Hi team, I am facing issue while splitting file based on 100mb size. In my case, i have 10 million records of data. i am using sl.range() function along with map() function.For example, if a line consists of 3mb data and i want to split based on 6kb....
Hi team,I m new to snaplogic and I want to split large fil into smaller files and zip them together. Any suggestions and explanations would be helpful.
Hello, I am trying to call a rest get API with some pagination. The API returns the next page URL within the response, so i should be able to use this in the snap. I am getting the value using JSON Path seen here in a mapper as an example: I use th...
Hello,I am calling Trustpilot API using HTTP request snap.I have given below values in 'Next URL' and 'has next' values in HTTP request snap.It is only giving 20 records.can you please provide your inputs?jsonPath($, "$.[*].links[?(@.rel=='next-page'...
Hello, I have source data in XML format and all the column entities have "@" as a prefix. I am trying the following expression using "hasPath" function in a mapper to determine if the output of the file has data.$.hasPath('Extract.Locations.Location....
When designing pipelines we have environment specific parameters (Dev, Test, Prod) in expression libraries. This renders our pipeline development independent of having to alter pipeline parameters or tasks between environments and deploys. However, t...
Hi, I am building error handler (with functionality to log error details in snowflake) for a nest pipeline (3 layers), and have a few questions 1. I want have captured pipeline parameters such as ruuid, startTime, but when I execute the functionality...
