Designing and Running Pipelines

How to run many rest calls to output to many CSV

I am building a large data extract and have to run many API calls and then output them to CSV files. Is there a way I can run a whole bunch of those rest calls and then output them to randomly named files. Thanks for your help.

Pickup string from source file-name to use in pipe-line

I need to read the plant-code which is either part of the source file-name or folder-name that is read via SFTP and then generate an output file with the same plant-code as part of the target file-name. How can I do that? The second part of the same ...

SQL Server Insert snap really slow

I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.

How to filter instances using mapping root

I want to set my mapping root on an array of objects, but I only want to pull back a subset of the objects based on one of the object properties. Is there any way to do this in the mapping root?

Resolved! Value to Field Mapping

Hi everyone, I’ve been trying to find a function that would allow a “Value to field” mapping such as this: As depicted, i would like to use Values as Keys in order to use them in expression libraries for value mapping tables. I’ve been trying severa...

Data Validator - allow null values

I’m trying to use the Data Validator snap to validate birthdays in a file. The birthday (DOB) field is optional - it can be null, but if there is a date it needs to be in the proper format. I have this regex in my Data Validator, but it is catching n...

Temp folder relocation

Hi community folks, So we recently added a partition to our groundplex server. Is it possible to relocate the TEMP folder that Snaplogic uses to that partition so that it is off the OS drive?

REST GET SNAP retry and timeout not dynamic

Hi all we are using the REST GET snap. In there we see that the timout ( connection timeout and read timeout) as well as the retry ( maximum request attempts and retry request interval) cannot be define dynamically. Is there a good reason for it? Or ...

SnapLogic - Integration Nation

Forum Posts

How to run many rest calls to output to many CSV

Pickup string from source file-name to use in pipe-line

SQL Server Insert snap really slow

How to filter instances using mapping root

Resolved! Value to Field Mapping

Data Validator - allow null values

Temp folder relocation

REST GET SNAP retry and timeout not dynamic

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...

Best way to perform multiple search and replace in...

Obtain Rest API curl to run in postman directly

CSV parser cannot parse data

Parsing XML using a Python script returns an encod...