mapper

46 Topics

AWS S3 Connection failure
Hello, I am trying to connect to the AWS S3 bucket with the Access Key Id and Secret access key using the AWS S3 Account type in Snaplogic. But it fails to validate and throws an error Failed to validate account:Cause: Access Denied (Service: Amazon S3; Status Code: 403 Using the same credentials I am able to connect with AWS S3 Bucket using AWS CLI and in PostMan as well by selecting Authorization type as AWS Signature. Can someone please help to identify why it is failing to connect in Snaplogic only?
Vikas2022
3 years ago Place Designing and Running Pipelines
3.5KViews
1like
2Comments
Mapper Snap: Valid Column Names In Input Schema Give "Undefined" Error
Hi, I am experiencing an issue where I have a Mapper Snap that gives the error: $[FieldName] is undefined when I input a field name in the expression box. The fields that I am using are inside the input schema of the mapper snap (I have dragged and dropped) so I know that the fields are valid. I have tried refreshing the page, restarting my browser and clearing cache to eliminate the possibility of it being a browser issue. Does anyone know what could be the cause of this problem?
JPaps
3 years ago Place Designing and Running Pipelines
6.6KViews
0likes
9Comments
Get each value from an array and create for each a record
HI experts, I have this input and the array of EmailAdresses can consist of 1 - 5 addresses: [ { “BusinessPartner”:“10”, “LastName”:“lam”, “SearchTerm1”:“lam”, “to_BusinessPartnerAddress”:{ “results”:[ { “BusinessPartner”:“10”, “Country”:“DE”, “to_EmailAddress”:{ “results”:[ { “EmailAddress”:[ “info@gmail.com”, “test@gmail.com” ] } ] } } ] } } ] I want to accomplish this (get all the values from the array and put them below each other as strings): [ { “BusinessPartner”: “10”, “LastName”: “testlastname”, “SearchTerm1”: “lam”, “to_BusinessPartnerAddress”: { “results”: [ { “BusinessPartner”: “10”, “Country”: “DE”, “to_EmailAddress”: { “results”: [ { “EmailAddress”: “info@gmail.com” }, { “EmailAddress”: “test@gmail.com” } ] } } ] } } ] How can I accompllish this I already tried to change it to an object, but I think it’s something with mapping. Regards Jens
Solved
JensDeveloper
3 years ago Place Designing and Running Pipelines
3.4KViews
0likes
1Comment
Mapper dynamic content
Hello! I have REST API source from which I ingest data and load it to BigQuery. I am executing this dynamically with parameters as there are multiple endpoints to query. I am using mapper to define the schema before loading, in this case with the pass-through enabled. However, I have run into a problem, that sometimes the API doesn’t return certain object in the json. Then, when I auto-create the table during load, it may not define this missing column in the schema based on the sample, but then breaks when this column suddenly appears. Due to this being a dynamic pipeline, I cannot hard-code any single columns to the mapper, as the column names are different for each job. Also, the number of columns might differ. So is there a way to dynamically define the column names I want to keep from the source? For example I a good solution could be one where I can define a single json, array or some other sort of string that contains the namespace of columns I’d like to keep, and just give that as a parameter to the mapper. Just to showcase with an example what I would want out with the dynamic expression: Source 1: [ { “a”:“123”, “b”:“qwerty”, “c”:“aaa”, “d”:asd", “e”:“111” }, { “a”:“456”, “b”:“zxcvbn”, “c”:“bbb”, “d”:fgh", “e”:“222” } ] Target schema 1: a, b, c, e Source 2: { “h”:“123”, “i”:“qwerty”, “j”:“aaa”, “k”:asd", “l”:“111” }, Target schema 2: i, j, k Hopefully you get what I’m after 🙂 Thanks -Tuomas
Solved
Tuomas
3 years ago Place Snap Packs
5.9KViews
0likes
5Comments
How to find incoming data format(json,xml) dynamically in pipeline input view?
How to find incoming data format dynamically? Say for example, If the incoming data is JSON then I need to perform certain validation and flow for JSON If the incoming data is xml then I to perform certain operations. Can any one suggest How to find incoming data format during the run-time. by using single input view for the pipeline?
Surendar
3 years ago Place Designing and Running Pipelines
7.3KViews
0likes
6Comments
Failure: Unable to write to JSON-Path
JSON Path Test_2023_03_28.slp (6.4 KB) GOAL: Set up a mapper to write input document structure to new structure, deleting some paths, and renaming others. ERROR: “Failure: Unable to write to JSON-Path: $.ACHData.employeeId, Reason: Expecting object for JSON-Path field reference ‘employeeId’, found: String, Resolution: Change the path to refer to an object” How is a String not an Object in this use case?
Solved
tarena
3 years ago Place Designing and Running Pipelines
3.4KViews
0likes
1Comment
Help with adding a field in JSON output
I have a JSON output like this: { "Choices": { "1": { "Display":"Generating standard, automated reports (e.g. ERP, reporting tools)?" } "2": { "Display":"Generating non-standard / custom reports (e.g. spreadsheets)?" } "3": { "Display":"Responding to Ad Hoc data requests?" } "4": { "Display":"Reconciling, combining, or manipulating data across multiple systems, reports, tools, and excel sheets?" } "5": { "Display":"Analyzing data and building insights?" } "6": { "Display":"Other" } } "QuestionText_Unsafe": "Tools and Reporting</br></br>On an average, what percentage of your time in a given week is spent:" "DisplayDataExportTag": null "DisplayLogic": null} This is one of the result and have multiple like this. So here I have this Field “Choices” where I have these values in numbers then another Child Field “Display” Now I want antoher field with Display which will be TextEntry: “true” but only for the last one or the max one. So for eg: here in choices the last/max field is 6: "6": { "Display":"Other" } It should be like this: "6": { "Display":"Other", "TextEntry":"true" } How do I do that? I’m new to the language.
Solved
negi_sagar
3 years ago Place Designing and Running Pipelines
2.7KViews
0likes
2Comments
Create a Json from two seperate arrays Key and value
HI i have two arrays : 1.Name and 2. Values Names = [ “key1”,“key2”,“key3” ] Values = [ “Value1”,“Value2”,“Value3” ] I want output from snap as {“key1” : “value1”, “key2” :“value2” … }
Solved
ash42
3 years ago Place Designing and Running Pipelines
3.6KViews
0likes
2Comments
File Writer - Naming file name from input from Mapper
I have a pipeline where I want the file name to map from input schema I have in my mapper. How would I go about doing that?
manderson1
3 years ago Place Designing and Running Pipelines
2.2KViews
0likes
1Comment
Pass Through in Shared Transform Snap
What is the purpose of clicking the Pass through the box in a Shared Transform Snap? Does this limit the data which is being brought in and transformed via the integration?
jb84
3 years ago Place Designing and Running Pipelines
2.1KViews
0likes
0Comments