Forum Discussion

Senthilnaga91's avatar
Senthilnaga91
New Contributor III
2 years ago

Performance Improvement - Loading large CSV files to Snowflake

I have a use case to load some large CSV files (in GBs) from windows network drive to Snowflake. Used a CSV parser and loading it using Snowflake bulk load. Pipeline is running without any issues. However, it takes a lot of time to load the data. Is there a better way to do it ? Please suggest.

 

 

1 Reply

  • dpan32's avatar
    dpan32
    New Contributor II

    Use pipeline execute snap for the loading part and use the pooling concept