Solved
Redshift Bulk Load on Cloudplex
We have a Redshift cluster that we would like to load data into. Using the Redshift - Insert snap is simple, but prohibitively slow and isn’t the recommended way to load data into a Redshift. We woul...
Forum Discussion
@rmedeiros Looks like it’s syntax issue (count not found). In your error pipeline you don’t need to explicitly map each and every attribute. Rather have one open/unlinked input view mapper and use pass through option. Just add one/two fields in mapper (name of error pipeline name/ execution time etc.) and use the pass through.
If you don’t want to change your logic then select null safe option in your mapper in error pipeline.
You have a particular set of IDs you want to process, and that set counts 1000 records? Or you just want the first 1000 from the table?
I’ve a specific set of 1000 IDs as of today, tomorrow it could be 5k, 0.5k or even 40k. Due to limited knowledge, I’m putting those IDs in the where clause of the query.
Are you executing the pipeline, or just validating?
