I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.
Hi @msalter,
You can read about SQL Server - Bulk Load snap. There is documentation of the snap.
https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1439064/SQL+Server+-+Bulk+Load
Regards,
1 Like
Hi @msalter - You may want to try using the -b batch_size argument.
SQL Server bulk load - support for bpc -b batch_size argument
Thanks for the help. I totally missed that snap in the list. We’re writing @ ~ 4.5M records every 10 min or so. This was a big help!
Quick edit - 25M records every 1/2hr