โ02-07-2022 09:35 AM
Hi,
Iโm new to snap logic, I have two data sources (Oracle, SQL) the new is Oracle and existing is SQL.
The pipelineโs first run, runs as expected, but the second, where I would expect all data to be in the โunmodifiedโ output data preview is not working as expected. Iโm trying to find where my settings are incorrect.
Entire Pipeline:
Diff:
I believe my issue is similar to this
Any help is appreciated thank you,
โ02-07-2022 12:02 PM
Weโll need more info than this to help diagnose the issue. Please insert a Mapper in front of each input to the Diff and provide a screenshot of the input data in each Mapper so we can see what it shows for the data and the data types.
โ02-07-2022 01:55 PM
Sure thing, thanks again.
I believe it maybe a datatype issue with ORDER_TOTAL and ORDER_SUBTOTAL
Iโm able to get it to work properly with one record.
Oracle Mapper:
SQL Mapper:
Pipeline Overview:
Data Before Mapping Oracle Data:
Data After Mapping Oracle Data:
Data Before Mapping SQL data:
Data After Mapping SQL data:
Hope this helps, if you need anything else let me know
โ02-08-2022 08:45 AM
Try disabling Pass through
on the Mappers and instead, map each field individually so that the output from each Mapper is in a consistent order and has consistent types. I would suggest starting with just the three fields youโre mapping directly now, see how the Diff behaves, and if it behaves as expected, map another field. Repeat for each field until youโve got them all working or until you find a problematic field that makes the Diff behave in an unexpected way. Perhaps disable the snaps after the Diff so that youโre not changing any data until the Diff behaves as expected.
โ02-08-2022 12:15 PM
I think I have it halfway solved. it appears the Oracle Sort Snap was not working as expected.
In order to resolve I hard coded an โORDER BYโ in the Oracle Select statement, but after raising the โPreview Document Countโ to 2000 the validation and full run worked properly.
Guess it came back to new user mistake.
Thank you both for taking the time to help me through this.
Iโm sure iโll be back soon ๐