Forum Discussion

darshthakkar's avatar
darshthakkar
Valued Contributor
4 years ago

Join preview data different than the actual raw data

Hi Team, I’m joining 2 tables (one from snowflake and another from salesforce), I do have the raw data so that it helps me with my validation while designing a pipeline on snapLogic. While I use ...
expression_language
pipeline
transform
Ajay_Chawda's avatar
Ajay_Chawda
Contributor
4 years ago

HI @darshthakkar
Did you try executing pipeline upto that point and write data to file.
you can increase Preview Document Count to 2000 this might help to check data during validation.

Regards,
Ajay

  • darshthakkar's avatar
    darshthakkar
    Valued Contributor
    4 years ago

    @Ajay_Chawda, Yes I did execute the pipeline but the preview generated is not similar to the data expected. Rationale behind this statement:

    As I’m joining 2 tables, the primary key is an ID for both the tables, for instance, ID = 100 and Name (to be fetched field) is “Darsh”, preview would show Null although we know ID = 100 has a value for Name as Darsh, I’m confident with this as I have the raw data wherein I can do the validations.