Solved
Count number of records fetched/processed from a flat file/upstream system systems (snowflake, salesforce, oracle)/file writer without using a pipeline execute
Hi Team,
I’m looking to count records on a couple of scenarios listed below:
(1) Records fetched from a flat file (e.g. excel, csv) and writing the total counts of records into a new column
e.g...
Hey @darshthakkar,
You have couple of options here:
- Group by/Gate, and a maper after with $group.length function
- Aggregate snap
- snap.in.totalCount combined with Tail snap
Third one is a bit abstract and I’m not a big fan of, but I listed it as an option anyway.
Hope this helps,
BR
