Thanks all. I am trying to write only the records which has non numeric value for a by using below snaps and the filter condition as isNaN(parseInt($a)) == true. Pipeline completes successfully. Dashboard status showing filter input in 90 million and output as 30k. Since I have added a comment in the mapper after filter snap, I see the file with 30k rows with that comment. But I don’t see any other fields passed to the final file except the comment. I tried pass through and also pulled fields manually in mapper after filter, still same. Can anyone know the reason and possible resolution for this? Kindly help.
Regards,
Amar.
