Patterns

Patterns

Pipeline patterns help you get a head start on pipeline building.

Forum Posts

Sorted by:

Start a conversation

Ingest data from SQL Server (RDBMS) to AWS Cloud Storage (S3)

Contributed by @SriramGopal from Agilisium Consulting The pipeline is designed to fetch records on an incremental basis from any RDBMS system and load to cloud storage (Amazon S3 in this case) with partitioning logic. This use case is applicable to C...

Encrypt and decrypt sensitive data in a source

Created by @pavan This pipeline pattern will encrypt fields passed as JSON docs using a defined transform type (AES), and decrypts and gives back the original message. This pattern is useful for encrypting sensitive messages (credit card info, SSN, ...

Read data from Salesforce and write to SQS Producer

Created by @sreddi This pipeline pattern reads data from Salesforce with the Salesforce Read Snap and writes data into Amazon SQS using the Amazon SQS Producer Snap. Configuration Specify the Region and Queue name in the SQS Producer Snap. Sources...

Error Handler for Validation

Submitted by @stodoroska from Interworks This pattern should be called as an error pipeline and stores all the error records in to a csv file. Configuration Parent pipeline should be made that will invoke this as a error pipeline. Target location ...

Sync Excel to Marketo

Created by @mthammareddy For a row in an Excel spreadsheet, search for the lead in Marketo based on the email address supplied. If the lead does not exist in Marketo, add it. The Excel file should contain matching field names, such as: FirstName, La...

Batch sync new leads from Marketo to Amazon Redshift

Created by @mthammareddy When there is a new lead activity batch in Marketo, synch the batch into Amazon Redshift. Configuration This pattern also requires the Get Marketo Access Token pattern. Sources: Marketo Targets: Redshift Snaps used: Pipeli...

Salesforce Attachment to Box

Created by @skatpally This pattern downloads a (contract) attachment from Salesforce and writes it to Box. Maximum 25 MB attachment. Configuration Update the File path within the Box Write Snap to the correct directory within your Box instance. So...

Get list of Service Accounts in a SnapLogic Org

Created by @dmiller This pattern gathers the list of members within the specified org and filters out only those accounts that are service accounts. Parent Pipeline Child Pipeline Configuration In the parent pipeline, specify your org name in t...

Top Kudoed Authors

User

Count

32

6

4

3

2