Data Integration
Discuss data integration use cases and solutions from ETL, ELT, reverse ETL, and AutoSync.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Receiving Kafka Acknowledgement Time out

Hi Community!! Greeting!!We are trying to Read data from a Kafka consumer snap and are using a child pipeline (We are using Pipeline Execute) to write data into a zip folder. The pipeline is erroring with "SnapDataException: Timed out waiting for ack...

Resolved! Filter object from array

Hello, I need to filter out an object from the distributionCenterSpecificData array where countryCodes array is empty.input payload:[{            "rpn": "ABCD",            "gpn": "G12345",            "productName": "CATHETER",            "productDesc...

Max by New Contributor II
  • 479 Views
  • 1 replies
  • 1 kudos

SFTP Connection and Encryption Algorithms

After the August 2023 upgrade, our SFTP connections started failing due to the deprecation of some default signature protocols. I believe this happened with the 4.33 GA release. To get around this issue, we updated our snaplex node properties to incl...

alex_panganiban_0-1718295327418.png alex_panganiban_1-1718295429838.png

processing 1000k csv data

I have a requirement need to process 1000k records from sldb(.csv) file and process it parallelly using pipeline execute and push the 1000k records to the target system by preparing CSV file in snap logic and sending that file to the target system.Ch...

satya by New Contributor
  • 310 Views
  • 0 replies
  • 0 kudos

Resolved! Structuring the Data receiving from the Union snap

Hi all,Can anyone help me to figure out how can I format the data in more structural manner?Input Data:[  {    "account_name": "Prajwal",    "Name": "Jhonson Inc.",    "OwnerId": "0052w00000BUhAGAA1",    "StageName": "Negotiation/Review",    "CloseDa...

Prajwal by New Contributor II
  • 3862 Views
  • 4 replies
  • 2 kudos

Resolved! Google BigQuery Load (Streaming)

I am trying to load a table using the BigQuery Load (Streaming)  and I am getting this error message even though the table DOES exist within my defined projectid.  What is the number '610395521851' in place of the project id in the error message?:"me...