Issues using Diff Snap
Hi,
I’m new to snap logic, I have two data sources (Oracle, SQL) the new is Oracle and existing is SQL.
The pipeline’s first run, runs as expected, but the second, where I would expect all data ...
Forum Discussion
Thank you both for your quick responses. 😀
I’m dealing with a small set of data 498 records.
I’ve been using ‘Shift click Validate’ as a fall back when snaps are not behaving as I thought they should or I change the underlying file or database structure.
in order to simplify my issue (pretty sure this is new user growing pains) I’ve filtered both New and old data sources by id=271967386.
First run performs as expected:
Second run not so much (expected 1 record in the ‘Unmodified’ output)
I suspect it is due to data type? could anyone possibly confirm?
Oracle (new) data preview before Diff Snap:
SQL (old/existing) data preview before Diff Snap
I’m going to try using the mapper snap or another transform to solve.
Thank you all again for your time.
Update:
I cut down the data to only the ID field and recreated the destination SQL table, so 1 record 1 field and the issue was still present.
Adding a mapping snap which changed the ID(Oracle Source) from number to string seems to resolve it, but when I try to add other fields (still 1 record) the record is routed to the “Modified” output.
I’ve used notepad++ compare plugin on the two Diff snap’s inputs and they are a match, this has really confused me
Mapper Snap Details:
Pipeline with mapper:
any advice appreciated
We’ll need more info than this to help diagnose the issue. Please insert a Mapper in front of each input to the Diff and provide a screenshot of the input data in each Mapper so we can see what it shows for the data and the data types.
