Is there an easier way to find the number of records in an incoming CSV? Want to log this information before processing the file. Appreciate the help but looking for a setting or simpler way to count the number.
Having the CSV file read, if you make a Group by N with Group Size = 0, then you only need to get the length property of the group.
Attached pipeline CSV_count_rows_2020_09_24.slp (6.0 KB)
I suggest that you need to read the file, then use and Aggregate Snap with no Group, and for the count, use the COUNT function on a String e.g. “A”. This will give you the count of rows without incurring much overhead.