Forum Discussion

KTsnap's avatar
KTsnap
New Contributor III
3 years ago

Replace value according to its poition

Below is the Input
[
{
@id”: “2”,
“col”: [
{
@id”: “2”,
@transable”: “yes”,
“$”: “Replace1”
},
{
@id”: “3”,
@transable”: “no”,
“$”: “Replace2”
}
],
“group”: [
{
“A”: “A1”,
“B”: “B1”,
“C”: “C1”,
“D”: “D1”,
“E”: "E1 ",
“F”: “F1”,
“G”: “G1”,
“H”: “”,
“I”: “”
},
{
“A”: “A2”,
“B”: “B2”,
“C”: “C2”,
“D”: “D2”,
“E”: “”,
“F”: “F2”,
“G”: “G2”,
“H”: “”,
“I”: “”
}
]
}
]


expected Output :

[
  {
    "group": [
      {
        "A": "A1",
        "B": "B1",
        "C": "C1",
        "D": "D1",
        "E": "E1 ",
        "F": "F1",
        "G": "G1",
        "H": "",
        "I": ""
      },
      {
        "A": "A2",
        "B": "Replace1",
        "C": "Replace2",
        "D": "D2",
        "E": "",
        "F": "F2",
        "G": "G2",
        "H": "",
        "I": ""
      }
         ]
  }
]

explanantion : @id refers to row number of the group and @id under col refers to the column number of the group where replacement needs to be done with  the value  of "$"

14 Replies

  • tstack's avatar
    tstack
    Former Employee

    You can do quite a lot with JSON-Path, it’s not limited to statically defined paths like $foo.bar. The filtering functionality makes it possible to quite a lot of stuff dynamically.

    That being said, it sounds like you need to be able to recursively remove objects that become empty as their descendants are removed. That kind of a task is out-of-scope for JSON-Path since it works on the full object tree at once. I think you can do what you want in the expression language, though. Since recursion is required, you’ll want to use an expression library to do the job. I’ll attach a library that contains a cleanupTree function that should do what you want. The function takes a value and, if it’s an object, calls itself for each field in the object and then filters out any fields that are empty objects. In other words, it will descend to the leaves of the object hierarchy, remove any fields that have empty objects and, if that empties out an object, that field will be removed.

    I’ll paste the library code in here since it’s pretty small:

    {
        // Returns true if the value is not an object or the object has fields.
        isNotEmpty: val => !(val instanceof Object) || !val.isEmpty(),
        // Recursively removes empty fields in an object.
        cleanupTree: root =>
          (root instanceof Object ?
             root.mapValues(this.cleanupTree).filter(this.isNotEmpty) :
           (root instanceof Array ?
           	 root.map(this.cleanupTree).filter(this.isNotEmpty) : root))
    }

    You’ll want to unzip the attachment on your computer and then import it into your pipeline via the Pipeline Properties dialog. You can then call the function in a Mapper using lib.objutil.cleanupTree($).

    objutil.expr.zip (325 Bytes)

    • THANKS for the help. On the recursive one, with the expression library, I installed the library in the pipeline profile expressions section. I did it as objutil, though I don’t think that matters. I tried the lib.objutil.cleanupTree($) in a mapper connected to the original mapper. It was put in the source section. I didn’t put anything in the target section. When I put it in the source section, it did show a preview of what was there, with … for the values. I even tried to change the name, to see if it gave an error, as I would expect. It did. So it looks like it is installed right. What am I doing wrong?

      The reason I want to do this is simply to exclude fields from being updated in the target, selectively. I don’t expect any special processing to be done between it and the target. Between this, and the option del specified, I think this would really help snaplogic’s customers on this type of problem.

      Del’s solution would probably work on 80% of the original concern, but the recursive option should work on just about everything.

      Steve

      • tstack's avatar
        tstack
        Former Employee

        You need to put $ in the target path so that the result of the cleanupTree() function is used as the new output value. The ‘Pass Through’ option should also be unchecked. Without $ in the target path, lib.objutil.cleanupTree($) is treated as the JSON-Path to delete.

    • ajs's avatar
      ajs
      New Contributor II

      I have a similar issue, but this expression library is not working.

  • del's avatar
    del
    Contributor III

    @stephenknilans,

    For your specific Address example, I found this expression to work:

    $Address.filter((v1,k1)=>!v1.value.filter((v2,k2)=>!v2.isEmpty()).isEmpty())

    Logically, it also works like this:

    $Address.filter((v1,k1)=>v1.value.filter((v2,k2)=>v2.isEmpty()).isEmpty())

    No recursion though, so @tstack’s solution is definitely a better approach if that’s required.