Forum Discussion

fernandezso's avatar
fernandezso
New Contributor II
6 years ago
Solved

Transpose column into row csv file

I have a pipeline that reads two csv files from different servers, i want to put together the data of both csv files into one. I used a union snap to put the data together but if one server is down i...
pipeline
sample_pipeline
transform
koryknick's avatar
koryknick
Employee
6 years ago
Copy LinkReport

Try adding an Exit snap after the Emailer with threshold at 0 to fail the pipeline if either source fails. You may also have to set the batch size property in the Emailer to 1 to prevent record batching.

This should allow you to continue to use the Union snap and avoid the “added columns” issue.

  • fernandezso's avatar
    fernandezso
    New Contributor II
    6 years ago
    Copy LinkReport

    I just put the exit snap but since one server stills up it is sending the information to the file writers, and creating the csv file with half of the information: