Forum Discussion

mohit's avatar
mohit
New Contributor
5 years ago

Parse Excel file with duplicate columns

Hi All, I have same column name multiple times in excel file. I want to parse all and load them into database but excel parser throws error of duplicate columns. Please suggest. Thanks
igormicev's avatar
igormicev
Contributor
5 years ago

Hi @mohit,
You can read-in the excel file with duplicate columns if you have the un-checked the “Contains headers” in the next “Excel Parser” snap

Then with a mapper, you can remove the duplicate column and introduce a row number (snap.in.totalCount) column at the same time, because in the next step you’d want to filter the first row that contains the real Headers, … so ending up with something like this:

Example pipeline attached:
IM_remove_duplicate_columns_example_2021_01_05.slp (7.7 KB)

/Igor