marenas
3 months agoContributor
Combine CSV document into a new file
Hello,
I’m reaching out regarding a pipeline that I am building. Here are the details:
Requirement: Combine two csv files (one has a header and the other one does not have)
Steps Taken:
I’m reaching out regarding a pipeline that I am building. Here are the details:
Requirement: Combine two csv files (one has a header and the other one does not have)
Steps Taken:
1. Read both csv files at the start of the pipeline
2. Use a 'Gate' snap to combine both inputs
3. Concatenate both inputs using a Mapper with the following expression: [].concat($['doc1'],$['doc2'])
Target path: $data
4. Split the data using JSON splitter
JSON Path to Split: jsonPath($, "data[*]")
5. Write the csv file
However, the result of my pipeline looks like this:
I have tried using Join type merge but the output looks like below which is not what I am trying to achieve.
What I expect the result to look like:
Appreciate your help on this.
-- Marrah
I found out it is possible to do this with a REST OAuth2 Account:
Select the 'Send Client Date as Basic Auth Header' check box
Select the 'Header authenticated' check box