Forum Discussion

sasikanth's avatar
sasikanth
New Contributor
5 years ago

Does Snowflake snappack 'Bulk Load' snap support ingesting data on to snow flake managed internal stage?

Snowflake has three kinds of stages before loading data on to snowflake dbs. 1/ Supported cloud storage, 2 / Internal snowflake managed named stage 3/ default table/user stage Bulk Load Snap’s d...
Snowflake
mbowen's avatar
mbowen
Employee
5 years ago

Hi sasikanth:

I’m not a Snowflake expert, but know some who are. Let me try to find an answer to your question. Some others in community may respond too.

  • mbowen's avatar
    mbowen
    Employee
    5 years ago

    One Snowflake snap (Bulk Load/Upsert) should be sufficient to load data into Snowflake.

    If snap is configured to use Input View as the data source with Internal staging, data will be written to a temporary file on the local Snaplex. Snap will then execute a PUT command to copy the temp file to Snowflake’s staging area; it will then write data from staging area to Snowflake target table via a COPY command.

    If the incoming data size is expected to be larger than the available size in the local Snaplex, you should use your own external staging (S3, Azure Blob, or Google Cloud Storage).

    You mentioned that it was difficult to make Bulk snap work for you. Were you getting an error?