Forum Discussion

amardeep2021's avatar
amardeep2021
New Contributor III
4 years ago

How it do insertion faster for redshift

I am trying insert 70K records in loop till a condition is false. Looping logic working fine. But, I see it takes 1 hour to insert 70K records each time. PFA of the pipeline I am executing. Is there a way to perform insertion faster? Any tips would be helpful.

Regards,
Amar.

10 Replies

  • ptaylor's avatar
    ptaylor
    Employee

    Unfortunately, no. When you preview the parent, you can only see the preview output of the snaps in the parent. There’s no way to see the preview output of the snaps that executed in the child during the preview of the parent. The preview output that you’re seeing in the child pipeline is left from when you last previewed just the child pipeline by itself.

    • ADORAISWAMY's avatar
      ADORAISWAMY
      New Contributor II

      Taylor,
      Thank you. I am bit more clearer and closer to the fix now. I enabled all the snaps and all but validated one. Please see attached. I tried with and without toggling the “=” button but neither works.

      • ptaylor's avatar
        ptaylor
        Employee

        Those expression buttons are toggled off. You definitely need them on. What’s the error when they are on?