Performance Improvement - Loading large CSV files to Snowflake
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-16-2023 12:08 PM - edited 10-16-2023 12:24 PM
I have a use case to load some large CSV files (in GBs) from windows network drive to Snowflake. Used a CSV parser and loading it using Snowflake bulk load. Pipeline is running without any issues. However, it takes a lot of time to load the data. Is there a better way to do it ? Please suggest.
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-27-2024 10:55 AM
Use pipeline execute snap for the loading part and use the pooling concept