Blog Post
How about scoring the response in runtime? The LLM are generally a pretty good judge of the quality of their answers, while not as reliable as evaluating against expected answers I found this approach to be a good way to spot inconsistencies or issues, or I use it to compare outputs after updating the automation. Granted, it's use case specific.