Separate file per record
How would you create a separate file per record instead of the standard file with multiple records
Forum Discussion
The output im looking for is csv.
I want to write 1 record per file.
The current pipeline is such as that all records are written to 1 file.
@jason.steindorf: As suggested earlier, you can use a “Group by N”, and then a pipeline execute to write individual files in any format you want.
There would be a parent pipeline where you put “Group by N” as the second last snap, Pipeline execute as the last snap. Your child pipeline will have a mapper --> csv formatter --> file writer
Please try using “Group by N” and you’ll see how those records get split into individual records.
Thanks @darshthakkar , i got it working
