This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

How to write a CSV using HDFS Writer

MEsponda
New Contributor

‎06-27-2023 03:40 PM

Hello!
I have a issue,

When I try to write a csv using the HDFS Writer… the snap aborted
So… the question is if someone know what is the limit size of the file that I can write using the HDFS Writer?

Because the file that I want to write is about 10 GB.

image

0 Kudos
1 REPLY 1

Swati_Sahoo
Employee
Employee

‎06-27-2023 10:29 PM

Hi @MEsponda

May I know ,you are trying for which protocol in HDFS writer snap? if it’s ADLS gen 2 (ABFS), snap is writing a 10 GB CSV file to abfs without any issue.

0 Kudos