Ultra lineage

[PSAmmirata]

I’m confused about the concept of maintaining lineage in an ultra pipeline. Specifically what’s needed to maintain lineage? And, what types of actions will break lineage? Is there any documentation that better explains this?

I’ve created a simple ultra pipeline that consists of a mapper snap that does not have pass through enabled and it works. I don’t understand how lineage is maintained in this instance.

[malladi]

I can’t send the runtime URL. as it has some clinent info.

[tlikarish]

This is a known regression and can be worked around by clicking “show more details” and you’ll see the underlying issue reported by that Salesforce snap. If you don’t want to work around it, then you can reach out to support and they can assist you with rolling back the change. The change is caused by a new ultra scheduling feature that should improve the start up time of ultra tasks.

[malladi]

@tlikarish In show more details the reason given is Generic streaming allocation at salesforce end and the reason due to the pipeline failure is lineage issue. I am not sure how both of these issues co relate to each other.

[tlikarish]

The lineage tracking is only used in an ultra pipeline when there is an open input view and is used to make sure the document was completely processed by the pipeline before being acknowledged. Since your pipeline has no open inputs, then the lineage tracking is not required. The error is a false positive and should be disregarded in this case.

[malladi]

Then you are saying that this issue will be fixed? Because this is affecting the purpose of ultra pipeline.