marenas
Contributor
Joined 5 years ago
User Profile
User Widgets
Contributions
Combine CSV document into a new file
Hello, I’m reaching out regarding a pipeline that I am building. Here are the details: Requirement: Combine two csv files (one has a header and the other one does not have) Steps Taken: 1. Read both csv files at the start of the pipeline 2. Use a 'Gate' snap to combine both inputs 3. Concatenate both inputs using a Mapper with the following expression: [].concat($['doc1'],$['doc2']) Target path: $data 4. Split the data using JSON splitter JSON Path to Split: jsonPath($, "data[*]") 5. Write the csv file However, the result of my pipeline looks like this: I have tried using Join type merge but the output looks like below which is not what I am trying to achieve. What I expect the result to look like: Appreciate your help on this. -- MarrahArray manipulation
I can't figure out how to manipulate the input so that I can have the desired output. Attached is the scenario that I wanted to solve. Here's what I tried: - a Conditional snap (see attached) - in Mapper, $entity.Attributes.map(x=>x.extend({Value:$ram})) But it updates all the elements in the array with property: Value (see attached). Thanks in advance.Re: Prompt response issue
Hi @heidi.andrew, Appreciate your response. Yes, you are right. The documentation states that the File Operation snap does not support SMB. I also did the same approach as you suggested. What I wanted to point out is the response given by SnapGPT, which in this case is incorrect.
Groups
Higher Ed Users Group
This user group is for customers within higher education.
