Forum Discussion

darshthakkar's avatar
darshthakkar
Valued Contributor
3 years ago
Solved

Converting value of input schema to distinct columns

Hi Team, I’m reading a text file and wanted to fetch DISTINCT columns out of the data itself, screenshot below for your reference. .txt file: When I read the above data in snaplogic, the f...
expression_language
pipeline
transform
koryknick's avatar
koryknick
Employee
3 years ago

If you can guarantee that these same 8 fields are always present, you could do a Group By N of 8, then process the array into an object. If missing values would remove the line, it becomes a bit more complex and may require a Script snap to handle the contextual parsing of the input.

darshthakkar's avatar
darshthakkar
Valued Contributor
3 years ago

@koryknick - We can handle “n” no. of rows with Group Size as 0

I will modify my 50 to 0 now as 0 will handle all the incoming rows.