I have seen that sometimes my Kafka to snowflake bulk insert is just stuck it does not process anything, neither it fails at the “Snowflake Bulk Insert snap”, like if there is a snowflake outage for 5 min, it gets stuck even after outgate is over, in that case, I manually restart the pipelines.
is there a way to stop the pipeline if it just stuck at “Snowflake Bulk Insert snap” for X minutes?
or any other better way to solve this.
