Forum Discussion

manohar's avatar
manohar
Contributor
5 years ago
Solved

Search in Array

hi there, I have data coming in these structures
source1 -

{
            "@type": "array",
            "order-line": [
              {
                "line-num": "00010",
                "attachments": {
                  "@type": "array",
                  "attachment": {
                    "type": "AttachmentText",
                    "text": "Testing the Long Text Documents"
                  }
                }
              },
              {
                "line-num": "00020",
                "attachments": {
                  "@type": "array",
                  "attachment": [
                    {
                      "type": "AttachmentText",
                      "text": "This is the Third time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    },
                    {
                      "type": "AttachmentText",
                      "text": "This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    }
                  ]
                }
              }
            ]
          }

and source2 -

{
      "line-num": "00020",
      "attachments": [
        {
          "type": "AttachmentText",
          "text": "This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n",
          "Id": null
        }
      ]
    }

how can I compare to see Source2 Atttachment.Text exists in Attachment.Text of Source1’s , where line-num is same?

Any help is greatly appreciated.

Thanks
Manohar

pipeline

8 Replies

    • manohar's avatar
      manohar
      Contributor
      5 years ago

      HI @bojanvelevski, Thanks for that. I am still trying to tweak this to fit into my requirement. will let you know how that goes.

      Thanks
      Manohar

  • Supratim's avatar
    Supratim
    Contributor III
    5 years ago

    @manohar Can try attach pipeline .

    compare_coummunty_2021_06_29.slp (10.0 KB)

    • manohar's avatar
      manohar
      Contributor
      5 years ago

      Hi Bojan,
      Very nice…

      there’s a small change in the requirement. Need to consider Date Time as well when comparing. if the Text matched is in the past then latest, then need to be added to the Line Num. If the Text matched is the latest, then need to ignore.

      Wondering how to get the latest of the 2 in this case, any pointers?

      Any help is greatly appreciated.

      Thanks
      Manohar

      
{
            "@type": "array",
            "order-line": [
              {
                "line-num": "00010",
                "attachments": {
                  "@type": "array",
                  "attachment": {
                    "type": "AttachmentText",
                    "datetime": "2021-07-04 18:20:10",
                    "text": "Testing the Long Text Documents"
                  }
                }
              },
              {
                "line-num": "00020",
                "attachments": {
                  "@type": "array",
                  "attachment": [
                    {
                      "type": "AttachmentText",
                      "datetime": "2021-07-04 18:20:20",
                      "text": "This is the Third time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    },
                    {
                      "type": "AttachmentText",
                      "datetime": "2021-07-04 19:40:21",
                      "text": "This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    }
                  ]
                }
              }
            ]
          }
  • manohar's avatar
    manohar
    Contributor
    5 years ago

    Hi @bojanvelevski

    We are letting go on looking for the Latest but instead we decided to add the date and time in the final text as below. if we were to search for rest of text (minus "datetime :- ") how would we do that?

    Your help is greatly appreciated.

    Thanks
    Manohar

    {
            "@type": "array",
            "order-line": [
              {
                "line-num": "00010",
                "attachments": {
                  "@type": "array",
                  "attachment": {
                    "type": "AttachmentText",
                    "datetime": "2021-07-04 18:20:10",
                    "text": "2021-07-04 18:20:10 :- Testing the Long Text Documents"
                  }
                }
              },
              {
                "line-num": "00020",
                "attachments": {
                  "@type": "array",
                  "attachment": [
                    {
                      "type": "AttachmentText",
                      "datetime": "2021-07-04 18:20:20",
                      "text": "2021-07-04 18:20:20 :- This is the Third time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    },
                    {
                      "type": "AttachmentText",
                      "datetime": "2021-07-04 19:40:21",
                      "text": "2021-07-04 19:40:21 :- This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n"
                    }
                  ]
                }
              }
            ]
          }
  • manohar's avatar
    manohar
    Contributor
    5 years ago

    Hey @bojanvelevski ,

    Thank you for all your help.

    Went bit different route using different snaps but used your logic in Compare_Community pipeline.

    Thanks
    Manohar