Forum Discussion

Paul-Emmanuel's avatar
Paul-Emmanuel
New Contributor
3 years ago
Solved

Clean duplicated lines in CSV datasource

Hi I am new with snap logic and not totaly familiar yet with all the concepts. I have some raw data, coming from CSV files which have duplicated lines. EDVdata.csv (105.4 KB) I have higlithed...
pipeline
transform
  • pradeepkumar's avatar
    pradeepkumar
    3 years ago

    Hi @Paul-Emmanuel

    Generally we can use sort snap following unique snap to deal with duplicate data but you need at least one unique data to work with, Need more information on your case to help.

pradeepkumar's avatar
pradeepkumar
New Contributor II
3 years ago

Hi @Paul-Emmanuel

Generally we can use sort snap following unique snap to deal with duplicate data but you need at least one unique data to work with, Need more information on your case to help.