ksalem
New Contributor III
Joined 8 years ago
User Profile
User Widgets
Contributions
SQS -pipeline stalling
Hi All, I am facing a peculiar issue with a new pipeline being built. the pipeline is setup to consume an SQS message > apply some processing and auditing(Via MySQL DB) > acknowledge the SQS message The pipeline runs correctly when the SQS Consumer Snap is set to message count 1. however the intention is for this pipeline to run permanently and constantly consume messages from SQS queue. when setting the message count property to -1 the pipeline does appear to work correctly until it reaches the first audit step where a 'MySQL Execute' is intended to insert an audit entry into a table (just a basic insert). in this instance the pipeline reaches this snap and indicates an input document of 1 but no output document or error document. (The MySQL execute is set to pass through and is not set to ignore empty results, so an output of some kind should always be expected): see attached screenshot I was unable to understand why this works when the SQS message count brings in exactly 1 message, but when set to -1 seems to fail silently here. the pipeline continues to run and further messages are picked up by the sqs but they are always held up at the MySQL step. Many thanks, Kareem.Re: Filter expression evaluate against all input documents
Thanks @cjhoward18 I did initially look at this kind of solution however not all secretary are given a position of secretary some may be assistant or receptionist. the other problem is that not all secretaries report to architects. If i was to write a script i would iterate through the document filtering firstly on architects and add them to a seperate list then if they have a secretery ID I would append those secretaries to that list. Im wondering if this can be done without the script snap though as I would prefer to use the out the box components to make the support aspect of this easier however it may be a case that script is the simplest way to goFilter expression evaluate against all input documents
Hi All, I am currently working on an integration which requires a subset of the documents I currently have. e.g. ID | Name| Position | SecID 1 |Bob | Architect |4 2 |Joe | Architect |3 3 |Steve | Secretery | 4 |Martin| Assistant | 5 |Eric | BA | 6 |Tom | PM | 5 This subset in this example would be the the list of all records with the position architect and also there secretaries E.g. ID | Name| Position | SecID 1 |Bob | Architect |4 2 |Joe | Architect |3 3 |Steve | Secretery | 4 |Martin| Assistant | I am aware I can do this in a script snap but wondering how if at all this could be done in the filter snap in a single expression?Re: Jgit + Dependencies (SLF4J)
Hi Robin, I Believe I have tried that but then running into issues similar to this thread: Slf4j Conflicts Developing Snaps Hi , After developing the custom snap and the deployment. While running the snap , I am getting the below error. In the package which I upload , there is third party jar which uses slfj logging. If I have the slf4j api jar in the package it says the below error org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" the class loader (instance of org/eclipse/jetty/webapp/WebAppClassLoader) of the current class,org/slf4j/LoggerFactory, and the class loader (instance o… not sure if you would possibly be open to a remote session to review this and if theres any options we might have missed? Many thanks, Kareem.
