Forum Discussion

dwhansen-cbg's avatar
dwhansen-cbg
Contributor
3 years ago
Solved

Redshift Bulk Load on Cloudplex

We have a Redshift cluster that we would like to load data into. Using the Redshift - Insert snap is simple, but prohibitively slow and isn’t the recommended way to load data into a Redshift. We woul...
redshift
  • koryknick's avatar
    koryknick
    4 years ago

    It’s the newline character in the string that is causing the issue. The dot notation for character matching in regex does not match newlines. After a bit of thought, we can also simplify the result by using the regex group capture syntax. Try this:

    $notes.replaceAll('\n','').replace(/.*#IF:(.{9}).*/g, '$1')
ptaylor's avatar
ptaylor
Employee
3 years ago

Well in that case, in what way isn’t it working? Are you getting an error? If so, please share the details.

dwhansen-cbg's avatar
dwhansen-cbg
Contributor
3 years ago

We think we figured out what was happening. Every 180 days we are required by our company policies to swap out our Access Keys and Secrets for security purposes. When we swapped them out, there was somehow a value in the Token field on the Redshift Account. We tried again by updating the Access Key and Secret, then clearing out the Token field and that seemed to do the trick. We’re not sure if this is a long-term fix or if it will fail again after a certain amount of time, but we are good to go for now.