How to write a CSV using HDFS Writer
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-27-2023 03:40 PM
Hello!
I have a issue,
When I try to write a csv using the HDFS Writer… the snap aborted
So… the question is if someone know what is the limit size of the file that I can write using the HDFS Writer?
Because the file that I want to write is about 10 GB.
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-27-2023 10:29 PM
Hi @MEsponda
May I know ,you are trying for which protocol in HDFS writer snap? if it’s ADLS gen 2 (ABFS), snap is writing a 10 GB CSV file to abfs without any issue.
