SQL Server Insert snap really slow

Question

I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.

viktor_n · Answer

Hi @msalter,
You can read about SQL Server - Bulk Load snap. There is documentation of the snap.
https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1439064/SQL+Server+-+Bulk+Load
Regards,

psammirata · Answer

Hi @msalter - You may want to try using the -b batch_size argument.
SQL Server bulk load - support for bpc -b batch_size argument

msalter · Answer

Thanks for the help.  I totally missed that snap in the list.  We’re writing @ ~ 4.5M records every 10 min or so.  This was a big help!
Quick edit - 25M records every 1/2hr

Forum Discussion

SQL Server Insert snap really slow

Recent Discussions

Javascript to promote top level lists

Google Sheets Subscribe questions

Basic string transformations not working

Can we generate XML file in pretty print format using native snapLogic snaps?

Multipart Reader failure - 'content-type' was not found