Designing and Running Pipelines

Placing multiple csv files in a common location

Hi Good day, I have a requirement where I need to place four source csv files in a location . Instead of using the csv formatter and file reader four times , do we have a method of combining all the four csv files and place it in a location . Here ea...

How to run many rest calls to output to many CSV

I am building a large data extract and have to run many API calls and then output them to CSV files. Is there a way I can run a whole bunch of those rest calls and then output them to randomly named files. Thanks for your help.

Pickup string from source file-name to use in pipe-line

I need to read the plant-code which is either part of the source file-name or folder-name that is read via SFTP and then generate an output file with the same plant-code as part of the target file-name. How can I do that? The second part of the same ...

SQL Server Insert snap really slow

I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.

How to filter instances using mapping root

I want to set my mapping root on an array of objects, but I only want to pull back a subset of the objects based on one of the object properties. Is there any way to do this in the mapping root?

Resolved! Value to Field Mapping

Hi everyone, I’ve been trying to find a function that would allow a “Value to field” mapping such as this: As depicted, i would like to use Values as Keys in order to use them in expression libraries for value mapping tables. I’ve been trying severa...

Data Validator - allow null values

I’m trying to use the Data Validator snap to validate birthdays in a file. The birthday (DOB) field is optional - it can be null, but if there is a date it needs to be in the proper format. I have this regex in my Data Validator, but it is catching n...

Temp folder relocation

Hi community folks, So we recently added a partition to our groundplex server. Is it possible to relocate the TEMP folder that Snaplogic uses to that partition so that it is off the OS drive?

SnapLogic - Integration Nation

Forum Posts

Placing multiple csv files in a common location

How to run many rest calls to output to many CSV

Pickup string from source file-name to use in pipe-line

SQL Server Insert snap really slow

How to filter instances using mapping root

Resolved! Value to Field Mapping

Data Validator - allow null values

Temp folder relocation

How to dynamically update an account?

Execute each child pipeline multiple times

Routing files from S3

Clean duplicated lines in CSV datasource

How to get all values of a key from objects in a l...

The "Pipeline execute" is changing data types?

Remove XML duplicate key from JSON list in XML for...

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work