Forum Discussion

rajesh_mangipud's avatar
rajesh_mangipud
New Contributor II
4 years ago

Get input file name from CSV parser

Hi, I have a set of CSV files that I read from using a CSV Parser. Is there a way the CSV Parser can also output the name of the file. I have already thought of putting the CSVParser in a child pip...
rajesh_mangipud's avatar
rajesh_mangipud
New Contributor II
4 years ago

Thanks Deepak. I have thought of that approach and then doing a cross join back to the main stream, but that does not seem to work when the input has multiple files.

So if there are 5 files and each file has 5 records, I need to write 25 records to the destination with each source file name identified (a column in the destination table)