Forum Discussion

RoyB's avatar
RoyB
New Contributor III
4 years ago

Exporting text file with CSV formatting, but with different numbers of fields

I’m working on a pipeline that needs to create and send a text file to a third party That text file contains rows formatted in the same was as a csv file The file contains a header row, then the ...
csv
mapper
RoyB's avatar
RoyB
New Contributor III
4 years ago

Thanks for the try, but it didn’t work.

I modified my pipeline to use your method, and it does the same thing.
The incoming document has a format of:
6 columns
33 columns (multiple rows)
6 columns

And then somewhere between the csv formatter and the File Write it turns into
6 columns
33 columns (multiple Rows)
33 columns

  • alchemiz's avatar
    alchemiz
    Contributor III
    4 years ago

    If you already have a flatten data and want to filter out objects that has a null value, try using the filter method in the root object

    Expression Target Path
    $.filter((val,key)=> !(val instanceof Null)) $