I plan to use Deduplicate snap to remove duplicate records from a CSV file. In my CSV file, let’s say I have 3 records with the same ID. I just want to keep 1 record.
So I am using Deduplicate snap and set it up like this
It works but it also remove some of the not duplicated records. Why?