This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Csv file with varying number of columns in each row

Go to solution
heidi_andrew
Contributor

โ€Ž02-06-2023 09:52 AM

my csv file has several rows for each person on the file. The specific rows have different number of columns in each row. CSV file reader is having trouble with it. Is this impossible to read for this snap?

0 Kudos
1 ACCEPTED SOLUTION

Go to solution
koryknick
Employee
Employee

โ€Ž02-22-2023 01:41 PM

@heidi.andrew - here is another pipeline that provides a couple more examples how this could be done. In this pipeline, there are two examples - the first is similar to what @alchemiz has done, but with an added step to simplify the syntax of the record conversion into an array then object. The second path steps it down even farther using all basic snap functionality to split the input stream so it can be parsed separately based on the input row type.

I hope this helps!
Community 15513 - Multi-row CSV_2023_02_22.slp (24.3 KB)

View solution in original post

17 REPLIES 17

Go to solution
koryknick
Employee
Employee

โ€Ž06-19-2023 07:19 AM

If you can attach a copy of the data in present and desired states, that would be very helpful.

0 Kudos

Go to solution
heidi_andrew
Contributor
In response to koryknick

โ€Ž06-20-2023 05:03 AM

There is a file attached to the ticket way early. That was the beginning state. I was able to pull that apart by rows, apply my fix and now all of the EEID rows are in one file, all of the OFFR rows are in one file, etc. Now i need to put them all back together like the one in the ticket.

0 Kudos

Go to solution
koryknick
Employee
Employee

โ€Ž06-20-2023 08:47 AM

Can you provide more detail of what youโ€™re doing now and what the current issue is, and perhaps why the solution provided earlier wasnโ€™t implemented?

Also - since this topic already has a listed solution, you might want to open a new post with your current challenge. Make sure you provide the details of your input, the pipeline youโ€™ve implemented so far, an example of the output you have, and the desired output.

0 Kudos