Forum Discussion

eguo's avatar
eguo
Former Employee
9 years ago

Capture runtime document in ultra pipeline for debugging purpose

Sometimes you want to capture input or output document of snaps at runtime in ultra pipeline for debugging purpose. Here’s a quick way: Don’t use File Writer Snap as it break the lineage in ultr...
ultra
vyasyash's avatar
vyasyash
New Contributor III
9 years ago

Hello Eguo,

Thanks for suggesting the way to capture the input/output document of snaps.

I’m new to SnapLogic world, and come from traditional ESB background. Wanted to understand if SnapLogic provides any out of the box feature to capture the input & output document for auditing and logging purpose (both in case of synchronous and async scenario). In production scenarios input/out payload will come handy to conduct RCA of the failed interface pipeline.

Thanks in advance.

Best,
Yashu Vyas

eguo's avatar
eguo
Former Employee
9 years ago

@vyasyash, welcome to the post-ESB paradigm!

No there is no out of box feature to persist messages like in traditional ESB, hence created the approach in this post to enable troubleshooting activities.

Benefits of this approach:

  • It avoids introducing new I/O endpoints into the pipeline. As a result, the pipeline has less state to manage in the runtime.
  • You could use Pipeline Monitoring API to consume the captured information to satisfy certain use cases.

Limitations:

  • Only the last rolling hundred sub-pipeline’s runtime logs will be kept by SL platform therefore visible in the dashboard and accessible via the Pipeline Monitoring API.
  • A runtime log will be kept in SL platform for 90 days.
  • Can not enable the reuse in the pipeExec snap.

Eddy