Change datatypes dynamically of every column

The CSVParser has some functionality for doing type conversion, but the types are expected to be in a separate file (see the Input Views section of the doc).

If you are not able to get your data in that form, I’m attaching an example pipeline that might do what you want. This pipeline uses a Router snap to split the first row off and then a Join to merge it back in with all the remaining rows. A Mapper snap is then used to do the type conversion with the following expression:

$.mapValues(
    (value, key) => match $types.get(key) {
        'char' => value,
        'integer' => parseInt(value),
        'date' => Date.parse(value, "dd/mm/YY"),
        _ => value
    }
)

Since that’s a little involved, I’ll go into some more detail. First, the mapValues() method is used to rewrite the value of each property in the input document. That method takes a callback that does the actual work. The callback uses the match operator to check the type of each property and then executes the conversion expression (e.g. the type of “Priority” is “integer”, so the match arm with parseInt(value) is executed).

TypeConversion_2019_09_16.slp (10.5 KB)