Inserting large data in servicenow
Hello Team, I am developing a pipeline in SnapLogic where there are 6000000 records coming from snowflake and i have designed my pipeline like this: Parent pipeline: snowflake execute...
Forum Discussion
deepanshu_1 - You can relieve some of the memory requirement off your snaplex nodes by removing the Group By N and JSON Splitter snaps and use the Batch Size option in the Pipeline Execute snap instead. This accomplishes exactly the same result without the memory consumption of combining large sets of records into a single document as an array.
If you are still experiencing slowness, you can follow-up with your ServiceNow admins to see if anything can be done on that side. I believe that ServiceNow is not really meant for batch operations, so inserting millions of records into ServiceNow is probably your bottleneck.
