Designing and Running Pipelines

Data size Calculation

Hi, I got one requirement which is related to data size. If data from source system is more than 1GB then I have to zip it else data should go in format of CSV and drop it at target location. So, Can any one help me if there is anyway to find the siz...

Extract data from website by navigating to desired hyperlink/tab

I have a below https link: cms.gov MMCO Statistical & Analytic Reports | CMS SPOTLIGHT & RELEASES 08/31/2022: CMS released the Full-Benefit Dual Eligibility Loss Report & Accompanying Data Tables (2015-2018 Data). Mor...

S3 Bucket dynamic creation

i would like to create bucket dynamically on run time. Is there any snap that i can use for Dynamic Bucket creation

MySQL Bulk Load and Auto_Increment field

I am not able to figure out how to set up my pipeline to allow MySQL to set the value for an auto_increment field. It only errors and tells me that I need to provide a value for that field. Can anyone out there help out?

PostGreSql connectivity

Hi, While trying to connect PostgreSQL using JDBC getting below error. . Could you please help to resolve this issue. Thanks in advance! Thanks, Venu

Can Snaplogic Throttle on behalf of a receiving applications basis a number configured

Hi Experts, We have a problem we are trying to solve using snaplogic. the flow is as simple as this but with multiple application (Application 1 + Application 2 + Application3 ) → (Feed Master) + Snaplogic → Application 4 To ensure Snaplogic received...

Validating a CSV file: either all rows are accepted or no rows are accepted

Good Morning: Looking to solve: Validation of a file as a whole. Should one record be invalid within a file that is read, then the entire file would be marked as invalid. No matter where the error occurs within the file. Additional info follows. I am...

Sharing pipeline Syntax

Hi I am facing an issue when trying to share a pipeline with another project. I have been following the answer suggested in this post Sharing Pipelines between Projects But on our impementation some reason it seems be unable to find a pipeline from a...

SnapLogic - Integration Nation

Forum Posts

Data size Calculation

Extract data from website by navigating to desired hyperlink/tab

S3 Bucket dynamic creation

MySQL Bulk Load and Auto_Increment field

PostGreSql connectivity

Can Snaplogic Throttle on behalf of a receiving applications basis a number configured

Validating a CSV file: either all rows are accepted or no rows are accepted

Sharing pipeline Syntax

What account should be used for API with query par...

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...