This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Clean duplicated lines in CSV datasource

Paul-Emmanuel
New Contributor

โ€Ž05-12-2023 03:20 AM

Hi
I am new with snap logic and not totaly familiar yet with all the concepts.

I have some raw data, coming from CSV files which have duplicated lines.
EDVdata.csv (105.4 KB)
I have higlithed some in the attached file
These have a slightly different timestamp but I donโ€™t care of the seconds, I want only one of the three.

Does somebody know how to make this cleaning but keep the column structure with something generic enough to not consider the number of columns?
That would be very helpful to me.

0 Kudos
1 REPLY 1

pradeepkumar
New Contributor

โ€Ž05-14-2023 11:00 PM

Hi @Paul-Emmanuel

Generally we can use sort snap following unique snap to deal with duplicate data but you need at least one unique data to work with, Need more information on your case to help.

0 Kudos