cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Read and process several CSV with different structure

WSC_SL
New Contributor

Hello everyone.

Please can you help me with this requirement.

I need to read a folder with several CSVs, but they have different structure and data type.

I got all the CSVs with plugin: "Multiple File Reader" but when I try to parse them, I only got one of them. The main requirement is that I have to transform only specific CSVs, not all, I mean,  I have to apply some conditions to manage the CSVs.

Thanks in advance

1 REPLY 1

RogerSramkoski
Employee
Employee

@WSC_SL My first thought here is to filter the the file names so you're only reading the ones you want to work with, then after the Multi-File Reader Snap, add a Binary Router so you can branch the files down different pathways for transformation depending on the file name. After the Binary Router you can use the Pipeline Execute Snap with the input view type changed from "Document" to "Binary". 

Here is a screenshot example: 

rsramkoski_0-1690990823714.png

Here is a Pipeline Execute with 'input0' changed from "Document" to "Binary" using the 'Type' drop-down box:

rsramkoski_1-1690990985406.png