โ06-24-2022 06:50 PM
Hi Team,
Iโm using an Inner Join and observing that the output preview doesnโt appear. Is this an expected behaviour?
I however, have access to the data Iโm expecting out of Inner join (as Iโm writing to an excel file) but using a mapper after Inner Join doesnโt help as there is no data in the input schema of the mapper. How do I filter the data that I donโt need out of the Inner Join when the preview is not available and Input schema is showing nothing?
I also have access to the other filtered data as I have enabled the error view in Inner Join and that does have an output preview to it.
Appreciate your help and time on this.
Best Regards,
Darsh
โ07-22-2022 01:47 PM
Look at the preview data for the Joinโs two inputs. Can you find a pair of documents from each view that should be joined?
If not, try increasing the preview count to 2000.
โ07-22-2022 01:57 PM
Thank you @ptaylor for your quick response.
This opens up a new discussion as Sort snapโs output preview is not aligned with the exported results. I have tried validating it with Shift + Validate
but havenโt found any luck. Some screenshots might help you understand this in detail:
Output preview of snowflake execute:
As the Name field is string in snowflake, used the following in the mapper:
Sorting it in ascending order so that the order matches with the flat file:
Output preview of Snowflake Sort:
This is amusing as if you check the exported flat file, the results will come in ascending order (snaps shared in my previous comment)
โ07-22-2022 01:58 PM
Long story short: No however I was expecting it to appear thatโs the reason Sort snap was used. If results are random, I can remove the sort snap as it is an overhead to the pipeline and would impact the performance.
โ07-22-2022 02:02 PM
The results are not random.
Can you please switch the preview type of the Sort output to display JSON instead of Table? I want to see if the NAME value is a string or a number.
โ07-22-2022 02:07 PM
Sure, please find the below screenshots for your reference: