Designing and Running Pipelines

Redshift bulk load have high input time

Hi Team, Could you please suggest why Redshift bulk load have high input time and how can we solve this issue. We are fetching data from SQL Server and inserting into redshift. Source records count : 59473885 Please refer to Pipeline execution stati...

Resolved! Script Snap Error: "[object JavaPackage] is not a Java class in nashorn:mozilla_compat.js"

I have a script snap that I’m using to do some weird data manipulation to amalgamate 3-hourly data and 1-hourly data into a consistent 1-hourly format. Here is my script, I’m using javascript code: // Ensure compatibility with both JDK 7 and 8 JSR-22...

Not Comparable Objects: BigInteger 350930 and Integer 350930

I’ve done a join to 5 tables. All works fine in validation. No errors at all. If I use a specific value in the where clause in the 4 SQL Selects, it’ll run fine. If I give it a parameter (instead of a hardcoded value). I get the error “Not Comparable...

Resolved! JSON returns Column Names separately from the Rows

I have a REST API that returns something like the following: entity": { “items”: [ { “tableName”: “mytable” “count”: 7995 “columnNames”: [ “c1”,“c2”,“c3”,“c4” ] “rows”: [ [r1c1value,r1c2value,r1c3value,r1c4value],[r2c1value,r2c2value,r2c3value,r2c4va...

Placing multiple csv files in a common location

Hi Good day, I have a requirement where I need to place four source csv files in a location . Instead of using the csv formatter and file reader four times , do we have a method of combining all the four csv files and place it in a location . Here ea...

How to run many rest calls to output to many CSV

I am building a large data extract and have to run many API calls and then output them to CSV files. Is there a way I can run a whole bunch of those rest calls and then output them to randomly named files. Thanks for your help.

Pickup string from source file-name to use in pipe-line

I need to read the plant-code which is either part of the source file-name or folder-name that is read via SFTP and then generate an output file with the same plant-code as part of the target file-name. How can I do that? The second part of the same ...

SQL Server Insert snap really slow

I’m writing ~ 200M records into a SQL DB but at the current rate (56,000 records over 2 hrs) I’ll be here a long time before it finishes. Wondering if I’m missing something in the setup or if there is something that needs to be tweaked elsewhere.

SnapLogic - Integration Nation

Forum Posts

Redshift bulk load have high input time

Resolved! Script Snap Error: "[object JavaPackage] is not a Java class in nashorn:mozilla_compat.js"

Not Comparable Objects: BigInteger 350930 and Integer 350930

Resolved! JSON returns Column Names separately from the Rows

Placing multiple csv files in a common location

How to run many rest calls to output to many CSV

Pickup string from source file-name to use in pipe-line

SQL Server Insert snap really slow

Generating individual files based on 'n' records f...

Convert array with objects into object with key/va...

Converting a string to JSON doesn't work

Rest Post for Multipart form type content type wit...

Best way to perform multiple search and replace in...

Obtain Rest API curl to run in postman directly

CSV parser cannot parse data

Parsing XML using a Python script returns an encod...

multiple array objects

String replace method where pattern is dynamic