I was trying to use parquet writer to write file into S3 folder - where i was unable to do it as it is throwing an error. I tried with other files where i could successfully write into S3. Kindly help me. It says that invalid path or aws account but both are good in terms of other file types when i am trying to write.
Failure: Failed to initialize parquet writer, Reason: May be due to an invalid account or directory path, detail: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found, Resolution: Address the reported issue.