02-02-2022 09:08 AM
I am trying insert 70K records in loop till a condition is false. Looping logic working fine. But, I see it takes 1 hour to insert 70K records each time. PFA of the pipeline I am executing. Is there a way to perform insertion faster? Any tips would be helpful.
Regards,
Amar.
02-03-2022 08:30 AM
I already have a filter condition before bulk load snap to restrict records. It still executing for 43 hours. Total record count in the target table is closer to 2.5 million records.
Is there a way to reduce this execution hours?
02-03-2022 09:03 AM
Can u share the screenshot of your pipeline design? Or a runtime ID would be great.
02-03-2022 09:56 AM
runid 595db8dd17f60c4b21d64513_b6b70371-72d5-40e1-9760-cfdb1b3f00be
02-03-2022 04:12 PM
Can you show us the execution time details? That way we know where is the bottleneck.
02-04-2022 07:53 AM
Hi Aleung, PFA. Kindly let me know if this is what you are looking for.