05-09-2018 09:55 AM
I have a requirement to load around ~300k records to a Redshift table.I have used Redshift Bulk snap for this purpose with the error count setting to 20000.I have an error pipeline called in this main pipeline. After executing this pipeline I was hoping the error pipeline to capture these error records(~6000) and load them to my error custom error table which is in Redshift. However I noticed these error records are not captured by the error pipeline or the error view. These error records can however be retrieved from Redshift standard table called ‘stl_load_errors’.I want to know a way so that I can have these error records captured in my custom error table or in the error view of the pipeline.