Designing and Running Pipelines

How to run many rest calls to output to many CSV

I am building a large data extract and have to run many API calls and then output them to CSV files. Is there a way I can run a whole bunch of those rest calls and then output them to randomly named files. Thanks for your help.

Pickup string from source file-name to use in pipe-line

I need to read the plant-code which is either part of the source file-name or folder-name that is read via SFTP and then generate an output file with the same plant-code as part of the target file-name. How can I do that? The second part of the same ...

SQL Server Insert snap really slow

I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.

How to filter instances using mapping root

I want to set my mapping root on an array of objects, but I only want to pull back a subset of the objects based on one of the object properties. Is there any way to do this in the mapping root?

Resolved! Value to Field Mapping

Hi everyone, I’ve been trying to find a function that would allow a “Value to field” mapping such as this: As depicted, i would like to use Values as Keys in order to use them in expression libraries for value mapping tables. I’ve been trying severa...

Data Validator - allow null values

I’m trying to use the Data Validator snap to validate birthdays in a file. The birthday (DOB) field is optional - it can be null, but if there is a date it needs to be in the proper format. I have this regex in my Data Validator, but it is catching n...

Temp folder relocation

Hi community folks, So we recently added a partition to our groundplex server. Is it possible to relocate the TEMP folder that Snaplogic uses to that partition so that it is off the OS drive?

REST GET SNAP retry and timeout not dynamic

Hi all we are using the REST GET snap. In there we see that the timout ( connection timeout and read timeout) as well as the retry ( maximum request attempts and retry request interval) cannot be define dynamically. Is there a good reason for it? Or ...

SnapLogic - Integration Nation

Forum Posts

How to run many rest calls to output to many CSV

Pickup string from source file-name to use in pipe-line

SQL Server Insert snap really slow

How to filter instances using mapping root

Resolved! Value to Field Mapping

Data Validator - allow null values

Temp folder relocation

REST GET SNAP retry and timeout not dynamic

Help to parse Json data into csv

Updating Salesforce contact object and Account Loo...

Slicing Data from JSON

Connecting Confluent Kafka using OAuth

Hexadecimal to binary conversion

array.map if field1 meets criteria, I want field2

Filter Array data

How to create timestamps and out put them only usi...

Do JSON mapping in a single mapper

Problem with nested mappings