Blog

3 Topics

How to write a CSV using HDFS Writer
Hello! I have a issue, When I try to write a csv using the HDFS Writer… the snap aborted So… the question is if someone know what is the limit size of the file that I can write using the HDFS Writer? Because the file that I want to write is about 10 GB.
MEsponda
3 years ago Place Designing and Running Pipelines
2.6KViews
0likes
1Comment
Rest API service endpoint returned erros result: Status Code =403
When configuring a REST Post of the mailjet API, it indicates the following message. Error: Reason: REST API service endpoint returned error result: status code = 403, reason phrase = Forbidden, refer to the error_entity field in the error view document for more details Resolution: Please check the values of Snap properties. Error Fingerprint[0] = efp:com.snaplogic.snap.api.rest.89xhsFt7 When performing the test in Postman, the execution is correct
emmanuel001
3 years ago Place Designing and Running Pipelines
3.5KViews
0likes
2Comments
Count number of records fetched/processed from a flat file/upstream system systems (snowflake, salesforce, oracle)/file writer without using a pipeline execute
Hi Team, I’m looking to count records on a couple of scenarios listed below: (1) Records fetched from a flat file (e.g. excel, csv) and writing the total counts of records into a new column e.g. File Reader --> Mapper (transformation rules here with new column added to count the total number of records) --> Excel/CSV formatter --> File Writer I’ve tried using snap.in.totalCount and snap.outputViews inside a mapper but didn’t get the expected results. (2) Records fetched from source system like snowflake, salesforce, oracle, etc. without using a count command in the query itself I’m thinking of using a Group By or an Aggregate snap to get the counts, would that be the right approach? (3) Counting number of records processed after the operation has been completed. For instance, I’m writing a flat file (excel/csv) but want a new column ingested into that file dynamically that states the total number of docs processed AND send an email to the team that states total number of docs processed. e.g. File Reader/Salesforce Read --> Mapper --> excel/csv formatter --> File Writer --> Mapper (anticipating this should have some rules) --> Email Sender (sends count ONLY) Thanking you in advance for your time and help on this one. Best Regards, Darsh
Solved
darshthakkar
4 years ago Place Designing and Running Pipelines
6.6KViews
0likes
2Comments