Array Rename

Hi @Majid

You should be able to use this expression in a mapper to replace the keys with the last value of the array, as well as remove it from the array:

$.mapKeys((val, key) => val.pop())

What @bojanvelevski said still holds true. However, I believe this is the expression you are looking for

@Majid,

Attached is a sample pipeline with a couple of options using the Pivot Snap to produce results similar to what your sample pipeline appears to be attempting. Both options use the same logic - the second just brings the grouping back together if desired.

It may not be your target solution, and my expressions could need a little work, but I hope it helps some with the direction you want to go.

Community.10510_2021_08_05.slp (30.4 KB)

@Majid,

Here is a version 2 of the pipeline that uses a Mapper and Splitter (instead of Pivot snap) for a dynamic pivot of the data. Community.10510_2021_08_05 (v2).slp (32.8 KB)

I’m not sure about performance, either, but I don’t know how you use your validator snap as-is without splitting/pivoting the data - because of the duplicate key issues.

As this is to be a generic pipeline, I think you might be better off using an Expression Library
in place of (or in conjunction with) your Validator. I think you could avoid the pivot, then.

Hi @Majid ,

There must be some more solid conditions for the logic, like, the name of the field will always be the second element in the array. But even if you define those conditions, this output cannot be achieved because you have two fields in the object with the same key, and that is not allowed. Revise and resend the requirements so we can help you better.

Regards,
Bojan

@cjhoward18 Thank you. This is renaming the arrays but as there is more than one fields in the object with same key name the output is just keeping the last instance.

@bojanvelevski Thank You. my requirement is to validate each field against different regex. I have used data validator with all possible regex I have and I was trying to rename the fields to corresponding regex name I have provided in data validator snap so that each field will be validated against associated regex. regex name will always be second and last element.

Attaching sample pipeline.
data-validation-regex_2021_08_05 (1).slp (15.3 KB)

If there is any other recommended approach to achieve this please let me know.

@Majid I’m glad the above helped.

I think I may be derailing too much by suggesting the expression library. It was a creative thought, but would require readjusting downstream logic to reach desired end result.

But, for an exercise, I put this together to show where my thought was leaning.
It basically changes your source:

	{
		"UBER_ID": [
			"1",
			"Integer_pattern"
		],
		"First_name": [
			"Majid",
			"TextOnly_pattern"
		],
		"Last_name": [
			"",
			"TextOnly_pattern"
		]
	}

to this:

	{
		"UBER_ID": [
			"1",
			"Integer_pattern",
			"valid"
		],
		"First_name": [
			"Majid",
			"TextOnly_pattern",
			"valid"
		],
		"Last_name": [
			"",
			"TextOnly_pattern",
			"invalid"
		]
	}

But you’d still have to handle this creatively in downstream snaps to get your desired results.

Community.10510.v3_2021_08_06.slp (4.9 KB)
community10510v3.expr.txt (376 Bytes)