Forum Discussion

Roger667's avatar
Roger667
New Contributor III
3 years ago
Solved

Unable to write salesforce data to s3 in parquet format

I Using saleforce read snap to read data and write to s3 in parquet format but getting error due to 'picklist' data type which is not compatible to parquet. How to handle such datat types problem
  • manichandana_ch's avatar
    manichandana_ch
    3 years ago

    Hi Roger667 

    Could you please check your SF read snap and make sure the 'Match datatype' is checked.

    Thanks !

Roger667's avatar
Roger667
New Contributor III
3 years ago

Hi manichandana_ch 

Thank you for your response. I successfully executed the SFDC_Parquet_Writer pipeline; however, the reader snap becomes unresponsive after processing a maximum of 2049 documents. It continues to operate indefinitely.
I tried breaking it down and this issue comes only when i add the parquet writer at the end