Forum Discussion

RoyB's avatar
RoyB
New Contributor III
4 years ago

Exporting text file with CSV formatting, but with different numbers of fields

I’m working on a pipeline that needs to create and send a text file to a third party That text file contains rows formatted in the same was as a csv file The file contains a header row, then the ...
csv
mapper
mbowen's avatar
mbowen
Employee
5 years ago
Copy LinkReport

Here is a community post about stripping line endings; maybe this could be used to normalize embedded EOL characters in your data, such as \r\n -> \n.

I can research Redshift Bulk Load’s additional options … The COPY command has quite a few options, I see a CSV data format parameter too.

  • Nidam's avatar
    Nidam
    New Contributor
    7 years ago
    Copy LinkReport

    Hi,

    Long time ago, I encountered this also.
    If I remember well, it was due to the space in the right path header name.
    I don’t remember if you also should remove the space in the left path header but you may want to remove it also.

    You should use a mapper for each of your csv file and rename this two columns.

    Give it a try and let us know!