Forum Discussion
Based on what you are trying to accomplish, I suggest taking a look at our Diff snap. You can see a screenshot of the snap below. The two inputs are labeled to help clarify that the lower input is for the original and the outputs are also labeled so you can build separate streams for handling the possible outcomes. If you have a specific reason for trying to build the logic yourself with Join and Router, please let us know.
Hi,
Thanks for the information. Two thing I want to ask you for advice.
- I went through Diff Snap, can I know whether it will use any key column to compare between two files?
- this is regarding Join Snap, what is the use of Left Outer Join? if i cant differentiate new and old records? the inner join will give only matched records, the left outer join has to give both matched and new recrods right? then it will be easy to do insert/update.
Thanks in advance.
Anil
- RogerSramkoski6 years agoEmployee
Hello Anil,
The Diff snap looks at the entire record for comparison, not a single key. The documentation linked in the previous reply has sample pipelines to download then import, which can help you understand how the snap will function.
Regarding your second question, left outer join will take all the data from input0 and input1 that did not match. Our Join snap documentation has an example of what a data stream looks like for each join type.