cancel
Showing results for 
Search instead for 
Did you mean: 

How it do insertion faster for redshift

amardeep2021
New Contributor III

I am trying insert 70K records in loop till a condition is false. Looping logic working fine. But, I see it takes 1 hour to insert 70K records each time. PFA of the pipeline I am executing. Is there a way to perform insertion faster? Any tips would be helpful.

Regards,
Amar.

Screen Shot 2022-02-02 at 9.05.48 AM

10 REPLIES 10

amardeep2021
New Contributor III

I already have a filter condition before bulk load snap to restrict records. It still executing for 43 hours. Total record count in the target table is closer to 2.5 million records.

Is there a way to reduce this execution hours?

smudassir
Employee
Employee

Can u share the screenshot of your pipeline design? Or a runtime ID would be great.

amardeep2021
New Contributor III

runid 595db8dd17f60c4b21d64513_b6b70371-72d5-40e1-9760-cfdb1b3f00be

aleung
Contributor III

Can you show us the execution time details? That way we know where is the bottleneck.

https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2447474726/BETA+SnapLogic+Studio+Execution...

amardeep2021
New Contributor III

Hi Aleung, PFA. Kindly let me know if this is what you are looking for.

Screen Shot 2022-02-04 at 7.49.32 AM
Screen Shot 2022-02-04 at 7.51.40 AM
Screen Shot 2022-02-04 at 7.52.22 AM