Forum Discussion
@koryknick: What if the inputs that go into an Inner Join have been sorted, would the ouput preview be randomized or would it be based on the sorted input?
I sorted both the inputs and I was expecting some values in preview but I didn’t. If output preview is purely randomized then we can disregard this scenario. Some snaps below for your reference:
Pipeline showing no output preview on Inner Join:
Snowflake Sort snap exported results for references:
Flat file Sort snap exported results for references:
Preview count is 50, if it would have been 1, I could understand nothing coming on an output preview:
Screenshot of Join settings:
Without the output preview, its challenging to go ahead with other transformations using mapper, sort, etc. What would you suggest using instead of this?
CC: @ptaylor
Look at the preview data for the Join’s two inputs. Can you find a pair of documents from each view that should be joined?
If not, try increasing the preview count to 2000.
- darshthakkar4 years agoValued Contributor
Thank you @ptaylor for your quick response.
This opens up a new discussion as Sort snap’s output preview is not aligned with the exported results. I have tried validating it withShift + Validate
but haven’t found any luck. Some screenshots might help you understand this in detail:Output preview of snowflake execute:
As the Name field is string in snowflake, used the following in the mapper:
Sorting it in ascending order so that the order matches with the flat file:
Output preview of Snowflake Sort:
This is amusing as if you check the exported flat file, the results will come in ascending order (snaps shared in my previous comment)
- darshthakkar4 years agoValued Contributor
Long story short: No however I was expecting it to appear that’s the reason Sort snap was used. If results are random, I can remove the sort snap as it is an overhead to the pipeline and would impact the performance.
- ptaylor4 years agoEmployee
The results are not random.
Can you please switch the preview type of the Sort output to display JSON instead of Table? I want to see if the NAME value is a string or a number.
- darshthakkar4 years agoValued Contributor
Sure, please find the below screenshots for your reference: