โ09-09-2019 12:31 PM
I have 2 single field documents containing string representations of time (Ex: โ12:03:43โ) that when I use a Join snap with any join type, or when I use a Union, I see that there are items that donโt make it in the join.
I have tried various things and no matter how I join these two documents containing โtimeโ strings there are data-points dropped in the join.
I also have seen simple copy snaps drop data as well. I donโt have screenshots of this but it seems that running it through a โUniqueโ snap resolved that issue, although I donโt know why that should matter.
Solved! Go to Solution.
โ09-10-2019 08:57 AM
Have you verified this is also the case when you execute the pipeline? One thing you might be hitting is the preview document limit. This is specified in the designer settings. The default is set to 50. Is your setting larger than the amount of data being input into the Join?
What could be happening is that the Join is reading the first N documents on the left (upper) input. If 15:54:38
is after N, then it wonโt appear in the preview output.
โ09-10-2019 08:57 AM
Have you verified this is also the case when you execute the pipeline? One thing you might be hitting is the preview document limit. This is specified in the designer settings. The default is set to 50. Is your setting larger than the amount of data being input into the Join?
What could be happening is that the Join is reading the first N documents on the left (upper) input. If 15:54:38
is after N, then it wonโt appear in the preview output.
โ09-10-2019 10:47 AM
This must be the issue.
It looks like when I execute this doesnโt happen, but I was reluctant to do so when it appeared that data was being dropped.