Forum Discussion

pkoppishetty's avatar
pkoppishetty
Former Employee
7 years ago

Move data from AWS S3 to Snowflake Data Warehouse

Created by @pkoppishetty

The pipeline pattern moves data from AWS S3 to Snowflake Data Warehouse. The pattern contains a Directory Browser (to retrieve the file list from S3), Snowflake Execute, and Snowflake Bulkload Snaps (to load the corresponding files into Snowflake).

Configuration

File Reader Preview

Snowflake Bulkload Output

Table Data from Snowflake Select Snap

Sources: AWS S3
Targets: Snowflake
Snaps used: Snowflake Execute, Directory Broswer, File Reader, Snowflake Bulk Load, Snowflake Select

Downloads

Integration pattern for moving data from AWS S3 to Snowflake datawarehouse.slp (14.2 KB)

pattern
s3
sample_pipeline
Snowflake

1 Reply

  • manika5's avatar
    manika5
    New Contributor
    6 years ago

    I am trying to use the same example and getting below mentioned error in loading data into snowflake snap while adding JDBC JARs*

    Failed to validate account: Could not load JDBC driver for url: {snowflake-jdbc-3.6.18.jar} Cause: com.snowflake.client.jdbc.SnowflakeDriver (Reason: com.snowflake.client.jdbc.SnowflakeDriver; Resolution: Please verify that the driver exists at the provided location and that read permissions are granted)

    Could you please help me to resolve this issue?

    Thanks & Regards
    Mani