Cannot read more than 2,147,483,647 into a byte array
Hello, I am facing issue while reading a huge file (more than 2 GB) in size. I want to read the file and zip the file.I tried in 2 ways and in both i am getting the error. Method 1: After file reader snap, I am using a Binary to Document (Encode or Decode is set to NONE and also tried with BYTE_TO_ARRAY)snap followed by a mapper and then Document to Binary Snap(Encode or Decode is set to NONE and also tried with BYTE_TO_ARRAY) . In mapper following expression is used to map the data : $[‘content-location’].substr([‘content-location’].lastIndexOf(“/”) + 1) → $[‘content-location’] $content → $content In this case I am getting “Cannot read more than 2,147,483,647 into a byte array” error. Method 2: After File reader snap, in mapper i have used binary i/p and o/p view and used the following expression to map the data : $[‘content-location’].substr([‘content-location’].lastIndexOf(“/”) + 1) → $[‘content-location’] $content → $content After few seconds of execution, the pipeline is getting hung and I am getting error “Lost contact with Snaplex node while the pipeline was running” Is there something whcih I am missing ??
Perform a Post API OAuth 2.0 call to get token and pass token to a GET API Basic Auth Header
I need to make a Post Rest API call using OAuth 2.0 with client_id and client_secret and then pass the token to a Get Rest API snap to make the api call Client Authentication ‘Send as Basic Auth Header’. How can I do this using the Rest Snaps?
How i retrieve status information of master pipeline using Snaps in designer? without using dashboard and tasks
Hi.i am new learner in snaplogic please help me .I need to trigger an email when the master pipeline is running longer than expected like an hour is an usual expectation. how can i perform this job in pipeline? if my pipeline is running more than expected time the email will notify ourself. which snap is used to fulfil my requirement .please tell me.Create a file path with a date in File Writer snap
I have a pipeline that generates an output file that I would like to save in S3 with a file path of YYYY/MM/dd/file_name… e.g. S3://bucket/2023/08/09/file_name.csv. When I do this: “s3:///bucket/”+Date.now().getFullYear()+“/”+Date.now().getMonth()+“/”+Date.now().getDate()+“/fil_name.csv” It generates a path of 2023/8/9, How can I programmatically determine when to pad it with a ‘0’ for single digit months and days without including this data in the document being saved?
FTPS Connection Failing to read file
I am using the File Reader and connecting to an FTPS attempting to read in a file. It appears the connection is successful and when I look at the snap statistics it appears the connection is successful. It shows 1 under Documents but with 0 Bytes. The file previewer doesn’t have anything in it when launched. Is there a different configuration for FTPS?
