Forum Discussion

mohamadelmardin's avatar
mohamadelmardin
New Contributor III
8 years ago

Best practices to publish to a AWS SNS topic

SnapLogic currently doesn’t have a dedicated snap pack for AWS SQS and SNS integration. Though we can use JMS consumer/producer snaps to configure it for SQS seamlessly however there is no mechanism ...
aleung's avatar
aleung
Contributor III
8 years ago

In that case you need to get AWS CLI and python install it in your groundplex. Once you have this setup, you could try using “Execute Command Line” under Utilties folder in Box to execute: aws sns publish.

Reference: publish — AWS CLI 1.25.66 Command Reference

mohamadelmardin's avatar
mohamadelmardin
New Contributor III
8 years ago

@aleung

So you are referring me to use the CLI AWS SDK to integrate with SNS at runtime I have two questions there:

  1. I was able to download and run commands with AWS CLI on my local desktop machine but not sure how I would execute this command from my pipeline and after I set up and download CLI on groundplex. You mentioned Utilities folder in Box but were can I find it? Are you referring to Box (online file sharing service) snap pack or something else that I am completely out of context on? Also where is that Utilities folder located?

  2. Can I use another AWS SDK instead of CLI such as JavaScript or Python? The reason I mentioned these two other SDKs because I could leverage a script snap that supports any of these two languages and call the SNS API there. I am fine with the CLI if it works but I am just hinting for other suggestions if possible.

  • aleung's avatar
    aleung
    Contributor III
    8 years ago

    1.You can get access it here

    1. You could try JS and Python as you describe as well.

    Please let us know what ends up working for you.

    • mohamadelmardin's avatar
      mohamadelmardin
      New Contributor III
      7 years ago

      @aleung Just realized I never shared back my solution how I solved to publish to SNS topic directly from SnapLogic. I created this utility pipeline that leverage Python script to invoke AWS Java SDK to do the job.
      I am setting the AWS secrets and other configuration such as topic name as pipeline parameters but they could be loaded from anywhere.

      Attached is a PoC pipeline.
      Publish to SNS Topic_2019_01_04.slp (7.1 KB)

      I believe the AWS SDK are already installed on the groundplex node by default but if not you can download them from AWS site and drop them in the JVM library where the snaplex is running.

      • hirakangshu_nag's avatar
        hirakangshu_nag
        New Contributor
        5 years ago

        Hi Mohamed,

        I had the same requirement with sns that you had posted. So if i follow the approach that you mentioned here it will be good right?
        Or any additional step to be taken.

        Regards,
        Hirak