ContributionsMost RecentMost LikesSolutionsMS SQL Bulk Insert is there a way to perform a bulk insert operation to insert data into MS SQL? currently we have a pipeline that has about 3.5M records / documents. It takes a long time to insert all of these into SQL using the execute snap b/c I believe its performing an insert document by document. Any help is appreciated. Re: Make a list from multiple documents can you share how i would use this snap with the data from above? Make a list from multiple documents I have a need to create a single list from multiple documents. Here is an example of some JSON: [ { color: “test1”, value: “111” }, { color: “test2”, value: “222” }, { color: “test3”, value: “333” }, { color: “test4”, value: “444” }, { color: “test5”, value: “555” }, { color: “test6”, value: “666” }, { color: “test7”, value: “777” } ] and it looks like this: But I need to map all those documents into a single list that essentially looks like this to use in an IN statement: ’ 111’,‘222’,‘333’,‘444’,‘555’,‘666’,‘777’ How would I achieve this? How to join records with duplicates i have unique emails on the left side of the join for emails that have previously bounced from a mailing list. i have contacts from our CRM on the right side of the join and in some cases we have duplicates of the same email (they are valid duplicates b/c they are tied to specific user records that span multiple entities in our platform so no chance of cleanup). I can’t seem to get the join to work when there are duplicate values. Example: Left side of the snap has an email jdoe@acme.com. The right side from our CRM yields 3 contact records for that email jdoe@acme.com: Id = 123, email = jdoe@acme.com Id = 456, email = jdoe@acme.com Id = 789, email = jdoe@acme.com I’d like to map/mark each instance of the records above as “undeliverable = true”… but when I try a join the duplicates are left out. i’ve tried inner and outer joins. any guidance on this is appreciated. Re: Removing a column from JSON array Got it. That worked for me! Thank you both for the help. Re: Removing a column from JSON array hi @robin. the catch is (that i probably should have mentioned) is i am grouping the rows by the OwnerEmail b/c further down the pipeline I email the user 1 single email with an HTML Table email snap. The table loops through the $group variable. While the Group By Fields I set the OwnerName like so… the subgrouping $groupBy still contains the field that I grouped by that I don’t want in the html table in the email. here is what my json looks like (i blurred out the real emails but you can see the structure and the group part where i want to remove the owneremail value): Removing a column from JSON array Hello. say i have the following JSON: how can i remove one of the attributes / columns? Let’s say in the top left from the image above I want to remove the OwnerEmail value from that array… how could i do that in snaplogic? i’ve tried remapping but that breaks the grouping. Re: Converting JSON to HTML Table for Email Snap actually i believe its the “Batch Size” attribute that fixes this. When i change it from 100 to 1 it seems to behave the way I expect. Re: Converting JSON to HTML Table for Email Snap Hi Del. In this example it seems that its still only sending to 1 single email address even though I have the $groupBy.OwnerEmail in the TO variable of the email snap. I have it broken out into 2 groups and confirm that via the JSON i see multiple groupBy’s with emails yet its only sending one this way. Any ideas? Re: If within mapper ah wonderful that did the trick! i forgot about the question mark.