cancel
Showing results for 
Search instead for 
Did you mean: 

Convert an existing groundplex to support ultra pipeline execution

stantzos
New Contributor II

Hello Community,

we currently have a Groundplex consisting of 2 nodes. We have use cases that require ultra pipelines. The questions are:

  1. Can we extend the existing groundplex to support ultra pipelines? Is this possible by adding at least one feedmaster and re-configuring the existing nodes?
  2. Is there a downside in executing both ultra and normal pipelines on a ultra-ready snaplex?
  3. Is it common practice to have a snaplex/groundplex dedicated for executing ultra pipelines or mixed use is also fine?

Best regards!

1 REPLY 1

akidave
Employee
Employee

The steps to add new Feedmaster nodes would be

  1. Update the Snaplex properties in the Manager, configure the Server Type to FeedMaster for the hosts which are going to to be the feed masters https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/809009264/Deploying+a+FeedMaster+Node
  2. On the new nodes, install the Snaplex installer and copy the slpropz, start the service
  3. If there are multiple feedmaster nodes, add a load balancer which points to the newly added feedmaster node. Update the “Ultra load balancer” property in the Snaplex settings https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438250/Updating+Snaplex to point to the load balancer URL

The Ultra pipeline functionality should be ready at this point. Regular pipelines will continue to be processed on the Snaplex when this configuration is being done. Doing the Snaplex update will initiate a rolling restart on the existing Snaplex nodes to load the updated configuration. If the restart of the existing nodes needs to be avoided, then step 1 above can be skipped. Instead of that, to make the new nodes start as feedmasters, create a file /etc/sysconfig/jcc on the new nodes and add the entry

export BOOTSTRAP_NAME=feed_master

The existing Snaplex configuration slpropz can be used on the new nodes, with the above property added to make them start as feedmasters.

Ultra pipelines and regular pipeline can be used on the same Snaplex without issues. If there are tight performance requirements for the requests being processed by the Ultra pipeline, that is the scenario when it is recommended to separate Ultra pipelines and regular pipelines into dedicated Snaplexes.