Forum Discussion
rajesh_mangipud
4 years agoNew Contributor II
Thanks Deepak. I have thought of that approach and then doing a cross join back to the main stream, but that does not seem to work when the input has multiple files.
So if there are 5 files and each file has 5 records, I need to write 25 records to the destination with each source file name identified (a column in the destination table)
sumit-kumar
3 years agoNew Contributor
Hi Rajesh,
Probably too late to answer, you can achieve this by calling a child pipeline with filename and path as pipeline parameters.
Read the file in child, map data, use _filename as another column in mapper.
Get result of all the child pipelines in parent pipeline to combine into single file.