rajesh_mangipud
New Contributor II
Joined 9 years ago
User Profile
User Widgets
Contributions
Get order of records within a group
I have a situation something like this: Employee ID Effective Date Office 1 1/1/2023 San Francisco 1 1/1/2024 Oakland 2 6/1/2023 Sydney 2 12/1/2023 Tokyo I need to add an order column and end date of the previous record column. Can you please suggest any ways of doing this? The output should probably look like this: Employee ID Effective Date Office End Date Order 1 1/1/2023 San Francisco 12/31/2023 1 1 1/1/2024 Oakland 2 2 6/1/2023 Sydney 11/30/2023 1 2 12/1/2023 Tokyo 2 Best, Rajesh1.2KViews0likes1CommentRe: Get input file name from CSV parser
Thanks Deepak. I have thought of that approach and then doing a cross join back to the main stream, but that does not seem to work when the input has multiple files. So if there are 5 files and each file has 5 records, I need to write 25 records to the destination with each source file name identified (a column in the destination table)3.1KViews0likes1CommentGet input file name from CSV parser
Hi, I have a set of CSV files that I read from using a CSV Parser. Is there a way the CSV Parser can also output the name of the file. I have already thought of putting the CSVParser in a child pipeline and feed the name of the pipeline as a parameter and reading that out. But I was wondering if there was a better way. Best, Rajesh3.5KViews0likes3Comments