Clean duplicated lines in CSV datasource

[Paul-Emmanuel]

Hi
I am new with snap logic and not totaly familiar yet with all the concepts.

I have some raw data, coming from CSV files which have duplicated lines.
EDVdata.csv (105.4 KB)
I have higlithed some in the attached file
These have a slightly different timestamp but I don’t care of the seconds, I want only one of the three.

Does somebody know how to make this cleaning but keep the column structure with something generic enough to not consider the number of columns?
That would be very helpful to me.

[pradeepkumar · Accepted solution]

Hi @Paul-Emmanuel

Generally we can use sort snap following unique snap to deal with duplicate data but you need at least one unique data to work with, Need more information on your case to help.