erkonline
New Contributor
Joined 6 years ago
User Profile
User Widgets
Contributions
Re: How to Unzip tar.gz file
I was unable to unzip the .tar file but I hope here the solution to unzip the zip files Decompressing and reading WINDOWS zip files Designing Pipelines Here is a pipeline that reads a .zip file, decompresses (unzips) it and parses it contents. Please note that our current “Decompress” Snap only supports BZIP2, GZIP and DEFLATE. [image] Binary to Document Snap Encode or Decode property is set to NONE [image] Mapper configuration [image] Zip file read Snap configuration [image] This will return a binary stream and based on content-type, in this case we have an Excel xls file so we snap-in Excel Parser. Pipeline is attached, you need to … Hope that works for you.2.8KViews0likes0CommentsIs there any way to set variables to before executing snowflake statement
I would like to execute the 2 set variable statements before executing the select * from viewname. This view internally uses VAR1 and VAR2 variables. set VAR1 = ‘ABC’; set VAR2 = ‘XYZ’; Select * from dbname.schemaname.viewname ; Is there anyway to set variables before executing select statement1.7KViews0likes1CommentGetting Error streaming data while writing to a temporary file, reason=No space left on device
Using snowflake bulk load to load a big table. Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table. I have changed Buffer size from 10MB to 100MB but no luck. I am not sure what other settings need to change to run this pipeline. Here is the detailed error message. Snap errors: {ruuid=79122f75-f6ed-4af3-867b-012f2c8e03fa, label=Snowflake - Bulk Load, failure=Error streaming data while writing to a temporary file, reason=No space left on device, resolution=Address the reported issue.} Got the error after extracting 43+ Millions rows from source and not inserted any rows in the target table.2.9KViews0likes2CommentsSnowflake Bulk Load is giving error =Table does not exist in the database
Snowflake Bulk Load is giving error Cannot find table : “schemaname”.“tablename”, reason=Table does not exist in the database, resolution=Ensure the provided table exists in the database. If I change use Snowflake Insert Snap in place of Snowflake Bulk Load snap it is working fine. I am not sure why Snowflake Bulk Load is giving error. These pipelines were working fine couple of days back3.1KViews0likes3CommentsCalling a pipeline/task from curl command
I have created a pipeline/task and called that using curl command and it is returning the document which is available in the last snap. I have added error pipeline to it. Called main pipeline/task using curl again. When there is no error it is returning the document which is available in the last snap(from main pipeline) as expected but when there is failure it is simply returning instead of last snap output in the error pipeline. how to return some value to curl command when pipeline is failed and entered in error pipeline.2.7KViews0likes2Comments