Forum Discussion

amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago

How to remove columns with null value alone in pipeline?

Hi, I have a scenario where I have few columns have null value few not. Objective is to not to bring in columns with null value for each records. source: id a b c d e ...
amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago

Thanks Cole. Kindly share the other expression also.

Regards,
Amar.

  • cjhoward18's avatar
    cjhoward18
    Employee
    4 years ago

    You can use this expression:

    { filterEmptyKeys: (value, key) => value != null, cleanupTree: value => value instanceof Object ? value.mapValues(this.cleanupTree).filter(this.filterEmptyKeys) : value }.cleanupTree($)

    mapped to the target path $ to remove all null values from a nested JSON object