smahla
New Contributor II
Joined 3 years ago
User Profile
User Widgets
Contributions
Re: Reusable pipeline- Unable to fetch variable value in child pipeline -Snowflake Snap
Thanks @AleksandarAngelevski , @jcornelius , @bojanvelevski Not sure on how to use document parameters. Tried with pipeline parameters and assigned default values for pipeline parameter to get rid of validation error in child pipeline. During execution, child pipeline parameter default values got over written by values passed by parent pipeline. Thank you.2.3KViews1like0CommentsRe: Reusable pipeline- Unable to fetch variable value in child pipeline -Snowflake Snap
Thanks for your input @jcornelius. Do you have any sample pipeline with it? I am new to Snaplogic so appreciate if you could share any reference. @bojanvelevski Tried passing dynanic values from parent to child pipeline and it is working fine. But the child pipeline during validation shows error but runs fine when dynamic values are passed from master pipeline Is this expected? Please see the reference screenshots. Child pipeline after validation- Child pipeline- Snowflake-execute snap error details- Parameter defined in child pipeline- Though parent and child pipeline getting completed successfully and getting the desired results but wanted to confirm if child pipeline validation errors are expected or missing something? Thank you.4.2KViews0likes2CommentsReusable pipeline- Unable to fetch variable value in child pipeline -Snowflake Snap
Usecase- We are looking at creating a reusable pipeline to load data from table1 from source DB to table1 in target DB. Plan is to reuse the same pipeline for n tables. Option 1 - Created master pipeline and child pipeline. Master pipeline gets table name list from source DB. Then uses mapper and foreach snap to execute the child pipeline. Child pipeline loads table from source DB to target DB. Issue- Unable to use the parameter/variable value from master pipeline-foreach snap to child pipeline -snowflake select/execute snap. Master pipeline- Child pipeline- Anyone faced similar error or has recommendation for the approach on reusable pipeline. Thank You.Solved6.7KViews0likes7CommentsRe: Snowflake execute (select SQL)- Capture results
Thank you Jen. Yes, I could see the output of Snowflake-execute(Select SQL) in Mapper input schema now. Had tried with Insert SQL in snowflake-execute and it worked fine but when replaced INSERT with Select SQL it was not showing earlier. FOREACH snap, can we read the output of mapper and pass as parameter for child pipeline. Could see only pipeline parameters visible in the Foreach snap.2.9KViews0likes0CommentsSnowflake execute (select SQL)- Capture results
Hi, We are using Snowflake execute snap to run a metadata query against Snowflake and using the output of it in mapper snap. Snowflake execute snap- preview data shows expected data from sql. In the mapper snap, input schema is not available for snowflake execute-select sql. Is there a way to capture/use the results from snowflake execute-sql(select) and use it in mapper or subsequent snaps.3KViews0likes2CommentsSAP HANA to Snowflake - historical data load
Hi, We are evaluating if Snaplogic can also be used to move historical data from SAP Hana to Snowflake without performance challenges. Any recommendations for historical data movements, best practice or snap configuration from SAP Hana to Snowflake. Snaplogic Fast Data loader does not support SAP Hana as source endpoint.1.4KViews0likes0Comments