When Snowflake Fails Over
When an instance of Snowflake fails over to another secondary Snowflake account, is there a way to dynamically have the SnapLogic account find which Snowflake account is the new primary? Is there a way to query which of 2 Snowflake accounts are the primary?Solved2.1KViews0likes1CommentReusable pipeline- Unable to fetch variable value in child pipeline -Snowflake Snap
Usecase- We are looking at creating a reusable pipeline to load data from table1 from source DB to table1 in target DB. Plan is to reuse the same pipeline for n tables. Option 1 - Created master pipeline and child pipeline. Master pipeline gets table name list from source DB. Then uses mapper and foreach snap to execute the child pipeline. Child pipeline loads table from source DB to target DB. Issue- Unable to use the parameter/variable value from master pipeline-foreach snap to child pipeline -snowflake select/execute snap. Master pipeline- Child pipeline- Anyone faced similar error or has recommendation for the approach on reusable pipeline. Thank You.Solved6.7KViews0likes7CommentsSnowflake execute (select SQL)- Capture results
Hi, We are using Snowflake execute snap to run a metadata query against Snowflake and using the output of it in mapper snap. Snowflake execute snap- preview data shows expected data from sql. In the mapper snap, input schema is not available for snowflake execute-select sql. Is there a way to capture/use the results from snowflake execute-sql(select) and use it in mapper or subsequent snaps.3KViews0likes2CommentsSAP HANA to Snowflake - historical data load
Hi, We are evaluating if Snaplogic can also be used to move historical data from SAP Hana to Snowflake without performance challenges. Any recommendations for historical data movements, best practice or snap configuration from SAP Hana to Snowflake. Snaplogic Fast Data loader does not support SAP Hana as source endpoint.1.4KViews0likes0CommentsSnowflake Issues: Throws syntax error randomly for drop statements in snowflake execute snap. Also Bulk Load snap fails stating table does not exist
Snowflake Issues: Throws syntax error randomly for drop statements in snowflake execute snap. Also Bulk Load snap fails saying table does not exist with create table checked in. Also table does exist and there is no mistake in table name.1.8KViews0likes1CommentSnowflake Bulk insert just stuck, do not process any data
I have seen that sometimes my Kafka to snowflake bulk insert is just stuck it does not process anything, neither it fails at the “Snowflake Bulk Insert snap”, like if there is a snowflake outage for 5 min, it gets stuck even after outgate is over, in that case, I manually restart the pipelines. is there a way to stop the pipeline if it just stuck at “Snowflake Bulk Insert snap” for X minutes? or any other better way to solve this.1.4KViews0likes0CommentsCalling REST APIs with Parameters
I need to be able to call a REST endpoint that takes a UserId as a parameter. I’m curious how I can leverage snaplogic to loop over an undetermined list of userIds from one REST endpoint to call another endpoint passing the user id. Is this even possible in Snaplogic?Snowflake Bulk Upsert Key Column Issue
Hello, I’ve had luck getting the snowflake bulk load to work. But that loads and duplicates records. I have been trying to get the Snowflake Bulk Upsert to work so I can use key ID columns. I can’t get past the error that I have an invalid column name and to check if the column or table exist. Both the table and the column exist. Is there a setting or step I need to do before this?1.8KViews0likes0Comments