Forum Discussion

chthroop's avatar
chthroop
New Contributor III
3 years ago

Union Snap doesn't appear to be joining streams properly

Hi, I am trying to join documents from 10 exactly the same XLS files. The Union Snap should bring them all into one stream, but only the top file is coming through. Doesn’t work in Validation or in Execution.

pipeline
transform

4 Replies

  • alchemiz's avatar
    alchemiz
    Contributor III
    3 years ago

    Hi @chthroop ,

    Good day, I think you might want to use the join snap instead as union will stream another set of document

    Using the join snap, you can use the pipe.ruuid as the common id for all the streaming documents

    Thanks,
    MM

    • chthroop's avatar
      chthroop
      New Contributor III
      3 years ago

      Hi, I am not trying to join disparate data sets to create super set of fields. I have 10 excel files are the exact same format that I simply want to “stack” into one load…

      • alchemiz's avatar
        alchemiz
        Contributor III
        3 years ago

        Ahhh ok… now that you have the union snap in place try adding Gate snap at the end to collect all streaming documents and will stack it as an array