cancel
Showing results for 
Search instead for 
Did you mean: 

Clean duplicated lines in CSV datasource

Paul-Emmanuel
New Contributor

Hi
I am new with snap logic and not totaly familiar yet with all the concepts.

I have some raw data, coming from CSV files which have duplicated lines.
EDVdata.csv (105.4 KB)
I have higlithed some in the attached file
These have a slightly different timestamp but I don’t care of the seconds, I want only one of the three.

Does somebody know how to make this cleaning but keep the column structure with something generic enough to not consider the number of columns?
That would be very helpful to me.

1 REPLY 1

pradeepkumar
New Contributor

Hi @Paul-Emmanuel

Generally we can use sort snap following unique snap to deal with duplicate data but you need at least one unique data to work with, Need more information on your case to help.