cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

SQL Server Insert snap really slow

msalter
New Contributor II

Iโ€™m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) Iโ€™ll be here a long time before it finishes. Wondering if Iโ€™m missing something in the setup or if there is something that needs to be tweaked elsewhere.

image

image

image

3 REPLIES 3

viktor_n
Contributor II

Hi @msalter,

You can read about SQL Server - Bulk Load snap. There is documentation of the snap.
https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1439064/SQL+Server+-+Bulk+Load

Regards,

PSAmmirata
Employee
Employee

Hi @msalter - You may want to try using the -b batch_size argument.

SQL Server bulk load - support for bpc -b batch_size argument

msalter
New Contributor II

Thanks for the help. I totally missed that snap in the list. Weโ€™re writing @ ~ 4.5M records every 10 min or so. This was a big help!

Quick edit - 25M records every 1/2hr