โ02-24-2021 05:21 PM
Iโm writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) Iโll be here a long time before it finishes. Wondering if Iโm missing something in the setup or if there is something that needs to be tweaked elsewhere.
โ02-25-2021 06:23 AM
Hi @msalter,
You can read about SQL Server - Bulk Load snap. There is documentation of the snap.
https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1439064/SQL+Server+-+Bulk+Load
Regards,
โ02-25-2021 06:39 AM
Hi @msalter - You may want to try using the -b batch_size argument.
SQL Server bulk load - support for bpc -b batch_size argument
โ02-25-2021 08:33 AM
Thanks for the help. I totally missed that snap in the list. Weโre writing @ ~ 4.5M records every 10 min or so. This was a big help!
Quick edit - 25M records every 1/2hr